00000040:00080000:1.0F:1788846187.833712:0:17124:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788846187.833729:0:17124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788846187.833749:0:17124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788846187.833757:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0F:1788846188.220709:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1788846188.913915:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846188.913988:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846188.914113:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683547264 00000100:00100000:1.0:1788846188.914137:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683547264 00000100:00100000:1.0:1788846188.914219:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:1.0:1788846188.914232:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47467aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+8:2398:x1875740683547264:12345-192.168.203.20@tcp:16:kworker.0 00000100:00100000:1.0:1788846188.914387:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47467aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+8:2398:x1875740683547264:12345-192.168.203.20@tcp:16:kworker.0 Request processed in 157us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846188.914394:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:3.0:1788846188.914960:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683547136 00000100:00100000:3.0:1788846188.914968:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683547136 00002000:00100000:3.0:1788846188.915003:0:18601:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff90e47467a680 x1875740683547136/t0(0) o4->53da1059-0b4b-4ba8-a35c-806ac864d7eb@192.168.203.20@tcp:539/0 lens 504/0 e 0 to 0 dl 1788846199 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788846188.915016:0:18601:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e47467a680 with x1875740683547136 ext(0->8) 00002000:00010000:3.0:1788846188.915021:0:18601:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e47467a680 00000100:00100000:3.0:1788846188.915050:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1788846188.915059:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47467a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+8:2398:x1875740683547136:12345-192.168.203.20@tcp:4:bash.0 00000100:00100000:3.0:1788846188.917661:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47467a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+10:2398:x1875740683547136:12345-192.168.203.20@tcp:4:bash.0 Request processed in 2589us (3748us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788846188.917678:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00002000:00100000:3.0:1788846188.917692:0:18601:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff90e47467a680 x1875740683547136/t8589934599(0) o4->53da1059-0b4b-4ba8-a35c-806ac864d7eb@192.168.203.20@tcp:539/0 lens 504/448 e 0 to 0 dl 1788846199 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788846188.917702:0:18601:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e47467a680 with x1875740683547136 ext(0->8) 00002000:00010000:3.0:1788846188.917710:0:18601:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90e47467a680 00010000:00010000:1.0:1788846189.251998:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846189.885919:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846189.885955:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702485376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846189.886062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846189.886125:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702485376 00000100:00100000:3.0:1788846189.886135:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702485376 00000100:00100000:3.0:1788846189.886208:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788846189.886219:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702485376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788846189.886247:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788846189.886301:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702485376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846189.886325:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788846189.886350:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846189.886449:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702485376:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0F:1788846189.889557:0:18592:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1788846189.889597:0:18592:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00010000:00010000:3.0:1788846190.271168:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788846190.332456:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788846190.393935:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702485504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788846190.394038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846190.394426:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702485504 00000100:00100000:2.0:1788846190.394436:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702485504 00000100:00100000:2.0:1788846190.394502:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788846190.394515:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702485504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788846190.394611:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788846190.394695:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702485504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 184us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846190.394704:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788846190.394811:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702485504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788846190.394831:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846190.394838:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702485632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846190.394874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846190.394917:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702485632 00000100:00100000:2.0:1788846190.394922:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702485632 00000100:00100000:2.0:1788846190.394952:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788846190.394961:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702485632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846190.394983:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788846190.395023:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702485632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846190.395030:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788846190.395469:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702485632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846190.407908:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846190.407989:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683547392 00000100:00100000:1.0:1788846190.408004:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683547392 00000100:00100000:1.0:1788846190.408100:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:1.0:1788846190.408114:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+26:15561:x1875740683547392:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788846190.408246:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+26:15561:x1875740683547392:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 134us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846190.408255:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00080000:3.0:1788846190.408450:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788846190.414187:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846190.414240:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683547520 00000100:00100000:3.0:1788846190.414253:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683547520 00000100:00100000:3.0:1788846190.414336:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:3.0:1788846190.414350:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:15561:x1875740683547520:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788846190.414481:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:15561:x1875740683547520:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 135us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846190.414490:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00080000:3.0:1788846190.414515:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788846190.422333:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846190.423259:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683547776 00000100:00100000:3.0:1788846190.423274:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683547776 00000100:00100000:3.0:1788846190.423353:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1788846190.423364:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f404450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+26:15561:x1875740683547776:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788846190.423968:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f404450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+27:15561:x1875740683547776:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 603us (1647us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1788846190.423977:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000001:00080000:3.0:1788846190.441441:0:17068:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:3.0:1788846190.441489:0:17068:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e47d187180 refcount 2 committed 0 result 0 batchid 4294967530 00010000:00010000:0.0:1788846190.441499:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846190.441518:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788846190.441548:0:17068:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47f5c4d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e47d187b40 00000020:00080000:3.0:1788846190.441561:0:17068:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47f5c4e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e469badc00 00010000:00010000:0.0:1788846190.441571:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846190.441581:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0c200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846190.441586:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846190.441595:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846190.441617:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:0.0:1788846190.441620:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1788846190.441623:0:17128:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00010000:00010000:0.0:1788846190.441626:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846190.441636:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788846190.441753:0:17128:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788846191.289776:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846191.417845:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702485760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788846191.417926:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846191.420932:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702485888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846191.420995:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702486016:0@lo:400:kworker.0 00000100:00100000:3.0:1788846191.420998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846191.421036:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702486272:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.421043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846191.421067:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846191.421096:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702486528:0@lo:400:kworker.0 00000100:00100000:3.0:1788846191.421105:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702486784:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.421283:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846191.421305:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702487040:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.421326:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846191.421342:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702487552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788846191.421363:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846191.421382:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788846191.421388:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702486144:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.421411:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846191.421427:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702486656:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.421445:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846191.421459:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702487168:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.421623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846191.421693:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702486400:0@lo:400:kworker.0 00000100:00100000:0.0:1788846191.421728:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846191.421752:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702486912:0@lo:400:kworker.0 00000100:00100000:0.0:1788846191.421801:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702486272 00000100:00100000:0.0:1788846191.421809:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702486272 00000100:00100000:0.0:1788846191.421862:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702486400 00000100:00100000:0.0:1788846191.421865:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702486400 00000100:00100000:0.0:1788846191.421900:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788846191.421910:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702486272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846191.421958:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702486272:12345-0@lo:400:kworker.0 Request processed in 50us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846191.421965:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788846191.421983:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788846191.421989:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47467b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702486400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846191.422020:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47467b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702486400:12345-0@lo:400:kworker.0 Request processed in 31us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846191.422026:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788846191.422042:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788846191.422045:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846191.422160:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702485760 00000100:00100000:1.0:1788846191.422165:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702485760 00000100:00100000:1.0:1788846191.422196:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702485888 00000100:00100000:1.0:1788846191.422199:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702485888 00000100:00100000:1.0:1788846191.422217:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702487552 00000100:00100000:1.0:1788846191.422220:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702487552 00000100:00100000:1.0:1788846191.422230:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788846191.422506:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846191.422543:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702487296:0@lo:400:kworker.0 00000100:00100000:3.0:1788846191.422574:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788846191.422583:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702485888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788846191.422606:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788846191.422610:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47467bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702485760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788846191.422634:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788846191.422647:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702485888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846191.422654:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788846191.422671:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788846191.422682:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702487552:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846191.422683:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47467bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702485760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 442us (4752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846191.422694:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00002000:00000024:3.0:1788846191.422695:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788846191.422723:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702487552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846191.422729:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788846191.422748:0:19094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702486784 00000100:00100000:3.0:1788846191.422752:0:19094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702486784 00000100:00080000:0.0:1788846191.422779:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788846191.422784:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846191.422791:0:19094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788846191.422797:0:19094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702486784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846191.422827:0:19094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702486784:12345-0@lo:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846191.422828:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702486144 00000100:00100000:0.0:1788846191.422834:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702486144 00000100:00100000:3.0:1788846191.422835:0:19094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788846191.422881:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702486656 00000100:00100000:0.0:1788846191.422886:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702486656 00000100:00100000:3.0:1788846191.422890:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788846191.422899:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702486144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846191.422905:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788846191.422915:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702486656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846191.422939:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702486144:12345-0@lo:400:kworker.0 Request processed in 42us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846191.422947:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788846191.422963:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702486656:12345-0@lo:400:kworker.0 Request processed in 49us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846191.422972:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788846191.422996:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702486016 00000100:00100000:0.0:1788846191.423006:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702486016 00000100:00100000:0.0:1788846191.423034:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788846191.423040:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702486016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846191.423087:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702486016:12345-0@lo:400:kworker.0 Request processed in 47us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846191.423093:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788846191.423780:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702486016:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.423981:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702487552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788846191.424011:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702486144:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.424022:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702486656:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.424048:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846191.428543:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702487424:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.428662:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846191.429609:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702486528 00000100:00100000:1.0:1788846191.429619:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702486528 00000100:00100000:1.0:1788846191.429667:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702487040 00000100:00100000:1.0:1788846191.429670:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702487040 00000100:00100000:1.0:1788846191.429704:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702487168 00000100:00100000:1.0:1788846191.429708:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702487168 00000100:00100000:1.0:1788846191.429721:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702486912 00000100:00100000:1.0:1788846191.429724:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702486912 00000100:00100000:1.0:1788846191.429740:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788846191.429748:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702486528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846191.429821:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702486528:12345-0@lo:400:kworker.0 Request processed in 73us (8537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846191.429829:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788846191.429846:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788846191.429852:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702487040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846191.429892:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702487040:12345-0@lo:400:kworker.0 Request processed in 41us (8565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846191.429899:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788846191.429910:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788846191.429916:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702487168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846191.429964:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702487168:12345-0@lo:400:kworker.0 Request processed in 47us (8339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846191.429971:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788846191.429985:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788846191.429991:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702486912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846191.430025:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702486912:12345-0@lo:400:kworker.0 Request processed in 34us (5977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846191.430031:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788846191.430056:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788846191.430131:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788846191.430641:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b2d80 x1875740702487168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846191.430656:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702487168:0@lo:400:kworker.0 00000100:00100000:1.0:1788846191.430667:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702486528:0@lo:400:kworker.0 00000100:00100000:1.0:1788846191.430677:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702487040:0@lo:400:kworker.0 00000100:00100000:3.0:1788846191.433058:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702487424 00000100:00100000:3.0:1788846191.433071:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702487424 00000100:00100000:2.0:1788846191.433137:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702485760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846191.433138:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788846191.433149:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702487424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.433187:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702486400:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.433206:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702486912:0@lo:400:kworker.0 00000100:00100000:3.0:1788846191.433221:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702487424:12345-0@lo:400:kworker.0 Request processed in 74us (4558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846191.433228:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788846191.433271:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846191.433300:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788846191.433306:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e474667100, transno 8589934596 00000004:00080000:3.0:1788846191.433315:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788846191.433339:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702485888:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788846191.433344:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b3100 x1875740702487424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846191.433357:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702487424:0@lo:400:kworker.0 00000100:00100000:3.0:1788846191.433359:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702486272:0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.433406:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702487296 00000100:00100000:2.0:1788846191.433410:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702487296 00000100:00100000:2.0:1788846191.433434:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788846191.433440:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702487296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846191.433472:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702487296:12345-0@lo:400:kworker.0 Request processed in 32us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846191.433478:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788846191.434207:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788846191.434212:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846191.437585:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702486784:0@lo:400:kworker.0 00000100:00100000:3.0:1788846191.437605:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702487296:0@lo:400:kworker.0 00010000:00010000:1.0:1788846192.313757:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846192.500113:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846192.501070:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846192.501103:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846192.501152:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846192.501186:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683548288 00000100:00100000:0.0:1788846192.501195:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683548288 00000100:00100000:0.0:1788846192.501272:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:0.0:1788846192.501293:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2400:x1875740683548288:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846192.501379:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683548160 00000100:00100000:3.0:1788846192.501384:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683548160 00000100:00100000:3.0:1788846192.501417:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683548032 00000100:00100000:3.0:1788846192.501420:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683548032 00000100:00100000:3.0:1788846192.501445:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:3.0:1788846192.501453:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683548160:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846192.501492:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:1.0:1788846192.501503:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47467b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+12:2400:x1875740683548032:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846192.501587:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47467b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+12:2400:x1875740683548032:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 86us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846192.501595:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:3.0:1788846192.501642:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683548160:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 187us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846192.501652:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00080000:3.0:1788846192.501708:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788846192.501712:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788846192.501715:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846192.502308:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2400:x1875740683548288:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 1024us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846192.502318:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1788846192.504597:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683547904 00000100:00100000:2.0:1788846192.504611:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683547904 00000100:00100000:2.0:1788846192.504679:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 169 00000100:00100000:2.0:1788846192.504690:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:2400:x1875740683547904:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846192.511762:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:2400:x1875740683547904:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 7063us (11648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846192.511778:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 169 00000100:00100000:0.0:1788846192.513011:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846192.513106:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683548416 00000100:00100000:2.0:1788846192.513115:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683548416 00000100:00100000:0.0:1788846192.513457:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846192.513500:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846192.513535:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683548544 00000100:00100000:1.0:1788846192.513560:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683548544 00000100:00100000:1.0:1788846192.513608:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683548672 00000100:00100000:1.0:1788846192.513611:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683548672 00000100:00100000:1.0:1788846192.513631:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:1.0:1788846192.513640:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2400:x1875740683548544:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846192.513715:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2400:x1875740683548544:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 76us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846192.513723:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:3.0:1788846192.513730:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:3.0:1788846192.513739:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47467a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2401:x1875740683548672:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846192.513769:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47467a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2401:x1875740683548672:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 32us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846192.513776:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:2.0:1788846192.514152:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1788846192.514161:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2397:x1875740683548416:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:2.0:1788846192.514181:0:18598:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272f82 00000100:00080000:2.0:1788846192.514207:0:18598:0:(import.c:65:import_set_state_nolock()) ffff90e344597000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788846192.514273:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788846192.514277:0:18598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788846192.514443:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+2:2397:x1875740683548416:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 282us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846192.514459:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00080000:2.0:1788846192.514517:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788846192.514556:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788846192.514558:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846192.515817:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846192.515887:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846192.517060:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683548800 00000100:00100000:3.0:1788846192.517066:0:19094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683548928 00000100:00100000:3.0:1788846192.517073:0:19094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683548928 00000100:00100000:1.0:1788846192.517073:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683548800 00000100:00100000:3.0:1788846192.517269:0:19094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:0.0:1788846192.517275:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:3.0:1788846192.517279:0:19094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2397:x1875740683548800:12345-192.168.203.20@tcp:9:kworker.0 00000100:00100000:0.0:1788846192.517282:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2397:x1875740683548928:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:3.0:1788846192.517304:0:19094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272fba 00000020:00000080:0.0:1788846192.517309:0:19458:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272fc1 00000100:00080000:3.0:1788846192.517316:0:19094:0:(import.c:65:import_set_state_nolock()) ffff90e46e21c800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788846192.517316:0:19458:0:(import.c:65:import_set_state_nolock()) ffff90e46e21d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788846192.517358:0:19094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000001:00000004:0.0:1788846192.517358:0:19458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788846192.517496:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9c95b52-bf21-4a43-abed-5b176d36d076+2:2397:x1875740683548928:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 213us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846192.517503:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00010000:00010000:0.0:1788846192.517587:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846192.518195:0:19094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+2:2397:x1875740683548800:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 915us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846192.518220:0:19094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00010000:00010000:3.0:1788846192.518238:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788846192.519675:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788846192.519683:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788846193.344100:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788846194.057104:0:20465:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 01:43:13 (1788846193) 00010000:00010000:0.0:1788846194.362009:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846195.001999:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846195.002021:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702487680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788846195.002089:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846195.003376:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702487680 00000100:00100000:1.0:1788846195.003387:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702487680 00000100:00100000:1.0:1788846195.003631:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788846195.003642:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702487680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788846195.003671:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788846195.003740:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702487680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846195.003748:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788846195.003912:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702487680:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788846195.004083:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788846195.385897:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846195.516064:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702487808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846195.516688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846195.516803:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702487808 00000100:00100000:0.0:1788846195.516811:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702487808 00000100:00100000:0.0:1788846195.516865:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788846195.516875:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702487808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788846195.516908:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788846195.516956:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702487808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846195.516964:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788846195.517020:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702487808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846195.518764:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702487936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846195.518827:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846195.519139:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702487936 00000100:00100000:1.0:1788846195.519147:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702487936 00000100:00100000:1.0:1788846195.519196:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788846195.519206:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702487936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846195.519236:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846195.519283:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702487936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846195.519291:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788846195.519338:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702487936:0@lo:41:osp-pre-1-0.0 00000020:00080000:2.0:1788846196.029184:0:17068:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:1.0:1788846196.029232:0:17128:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:1.0:1788846196.029247:0:17128:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:1.0:1788846196.409952:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846196.538126:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846196.538154:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702488064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788846196.538220:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846196.538951:0:19095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702488064 00000100:00100000:3.0:1788846196.538960:0:19095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702488064 00000100:00100000:3.0:1788846196.539033:0:19095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788846196.539044:0:19095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702488064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788846196.539067:0:19095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788846196.539119:0:19095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702488064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846196.539125:0:19095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788846196.539732:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846196.539744:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702488192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788846196.539785:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788846196.540073:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846196.540087:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702488192 00000100:00100000:1.0:1788846196.540092:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702488192 00000100:00100000:1.0:1788846196.540131:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788846196.540149:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702488192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788846196.540170:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788846196.540209:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702488192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846196.540216:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788846196.540596:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702488448:0@lo:400:kworker.0 00000100:00100000:1.0:1788846196.540627:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846196.540651:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702488960:0@lo:400:kworker.0 00000100:00100000:1.0:1788846196.540674:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846196.540690:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702489472:0@lo:400:kworker.0 00000100:00100000:1.0:1788846196.540987:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846196.541009:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788846196.541016:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702488320:0@lo:400:kworker.0 00000100:00100000:1.0:1788846196.541041:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846196.541061:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702488832:0@lo:400:kworker.0 00000100:00100000:1.0:1788846196.541096:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846196.541111:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702489344:0@lo:400:kworker.0 00000100:00100000:1.0:1788846196.541130:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846196.541237:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702489472 00000100:00100000:1.0:1788846196.541242:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702489472 00000100:00100000:1.0:1788846196.541343:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702489344 00000100:00100000:1.0:1788846196.541346:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702489344 00000100:00100000:1.0:1788846196.541364:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788846196.541371:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702489472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846196.541486:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702489472:12345-0@lo:400:kworker.0 Request processed in 115us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846196.541494:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788846196.541646:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788846196.541654:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702489344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.542136:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702488576:0@lo:400:kworker.0 00000100:00100000:2.0:1788846196.542230:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702488960 00000100:00100000:2.0:1788846196.542236:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702488960 00000100:00100000:2.0:1788846196.542280:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702488832 00000100:00100000:2.0:1788846196.542283:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702488832 00000100:00100000:2.0:1788846196.542302:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788846196.542309:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702488960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846196.542381:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702488448 00000100:00100000:0.0:1788846196.542385:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702488448 00000100:00100000:0.0:1788846196.542419:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788846196.542425:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702488448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.543475:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846196.543533:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702489088:0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.543565:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846196.543577:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702489600:0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.543607:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846196.543645:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702488192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788846196.543665:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788846196.543670:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702488704:0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.544019:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846196.544046:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702489216:0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.544069:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846196.544081:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702489728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846196.544116:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846196.544161:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702488576 00000100:00100000:3.0:1788846196.544166:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702488576 00000100:00100000:3.0:1788846196.544194:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702489088 00000100:00100000:3.0:1788846196.544197:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702489088 00000100:00100000:3.0:1788846196.544208:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702489600 00000100:00100000:3.0:1788846196.544210:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702489600 00000100:00100000:3.0:1788846196.544234:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702489216 00000100:00100000:3.0:1788846196.544236:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702489216 00000100:00100000:3.0:1788846196.544451:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788846196.544462:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702488576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.544543:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702488576:12345-0@lo:400:kworker.0 Request processed in 82us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846196.544549:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788846196.544566:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788846196.544572:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702489088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.544613:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702489088:12345-0@lo:400:kworker.0 Request processed in 42us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846196.544618:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788846196.544629:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788846196.544635:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702489600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.544661:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702489600:12345-0@lo:400:kworker.0 Request processed in 26us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846196.544666:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788846196.544676:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788846196.544681:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702489216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.544983:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702489216:12345-0@lo:400:kworker.0 Request processed in 301us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846196.544995:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788846196.545039:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702488064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846196.545069:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702489216:0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.545078:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702488576:0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.545087:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702489088:0@lo:400:kworker.0 00010000:00080000:3.0:1788846196.545100:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343bae680 x1875740702489600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846196.545110:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702489600:0@lo:400:kworker.0 00000100:00080000:3.0:1788846196.545167:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788846196.545171:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788846196.545174:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846196.545195:0:19094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788846196.545204:0:19094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702488832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.545483:0:19094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702488832:12345-0@lo:400:kworker.0 Request processed in 49us (4154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846196.545492:0:19094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788846196.545565:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702488704 00000100:00100000:3.0:1788846196.545571:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702488704 00000100:00100000:3.0:1788846196.545763:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788846196.545891:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702488704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.545937:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702488704:12345-0@lo:400:kworker.0 Request processed in 168us (2241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846196.545943:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788846196.545990:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702488832:0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.546003:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702489472:0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.546027:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702488704:0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.546072:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702488320 00000100:00100000:3.0:1788846196.546076:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702488320 00000100:00100000:3.0:1788846196.546110:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788846196.546117:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3643:x1875740702488320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.546385:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3643:x1875740702488320:12345-0@lo:400:kworker.0 Request processed in 268us (5341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846196.546393:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788846196.546511:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702488320:0@lo:400:kworker.0 00000100:00100000:3.0:1788846196.546573:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702489728 00000100:00100000:3.0:1788846196.546577:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702489728 00000100:00100000:3.0:1788846196.546685:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788846196.546758:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1875740702489728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788846196.546961:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788846196.547009:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1875740702489728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 316us (2891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846196.547019:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788846196.547064:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702489728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788846196.551614:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702489344:12345-0@lo:400:kworker.0 Request processed in 9951us (10472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846196.551629:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1788846196.551916:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343bace00 x1875740702489344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846196.551931:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702489344:0@lo:400:kworker.0 00000100:00100000:2.0:1788846196.552349:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702488960:12345-0@lo:400:kworker.0 Request processed in 10037us (11670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846196.552360:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788846196.552384:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702488960:0@lo:400:kworker.0 00000100:00100000:0.0:1788846196.553679:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702488448:12345-0@lo:400:kworker.0 Request processed in 11249us (13046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846196.553693:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788846196.553922:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702488448:0@lo:400:kworker.0 00000040:00080000:3.0:1788846197.052096:0:17124:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788846197.052113:0:17124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788846197.052134:0:17124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788846197.052142:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788846197.266309:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846197.266474:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683549184 00000100:00100000:2.0:1788846197.266484:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683549184 00000100:00100000:2.0:1788846197.266577:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:2.0:1788846197.266588:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:2400:x1875740683549184:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846197.266602:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846197.266635:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0dc00/0x21b4d56138272fe4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549d6 expref: 13 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846197.266653:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846197.266710:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:2400:x1875740683549184:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 123us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846197.266717:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:1.0:1788846197.271459:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846197.271515:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846197.271672:0:20117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683549056 00000100:00100000:2.0:1788846197.271682:0:20117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683549056 00000100:00100000:2.0:1788846197.271730:0:20117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683549312 00000100:00100000:2.0:1788846197.271733:0:20117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683549312 00000100:00100000:2.0:1788846197.271767:0:20117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:2.0:1788846197.271776:0:20117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:2398:x1875740683549056:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846197.271790:0:20117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846197.271820:0:20117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aabe00/0x21b4d56138272f58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548ef expref: 13 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846197.271845:0:20117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846197.272071:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:3.0:1788846197.272081:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:2398:x1875740683549312:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846197.272089:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846197.272099:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272f5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754920 expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846197.272109:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846197.272133:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:2398:x1875740683549312:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 55us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846197.272140:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1788846197.272365:0:20117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:2398:x1875740683549056:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 117us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846197.272374:0:20117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:1.0:1788846197.282141:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846197.282223:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683549568 00000100:00100000:3.0:1788846197.282234:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683549568 00000100:00100000:3.0:1788846197.282310:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:3.0:1788846197.282322:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2397:x1875740683549568:12345-192.168.203.20@tcp:9:umount.0 00000020:00000080:3.0:1788846197.282359:0:18597:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272f7b 00000020:00010000:3.0:1788846197.282366:0:18597:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90e474532800: total 0 00000100:00080000:3.0:1788846197.282383:0:18597:0:(import.c:65:import_set_state_nolock()) ffff90e474530800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788846197.282430:0:18597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000020:00010000:2.0:1788846197.282626:0:17844:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90e474532800: total 0 00010000:00010000:2.0:1788846197.282630:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846197.282668:0:17844:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e474532800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1788846197.282699:0:17844:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788846197.282702:0:17844:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788846184 -> 1788846185 00002000:00010000:2.0:1788846197.282705:0:17844:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788846184 -> 1788846185 00002000:00010000:2.0:1788846197.282707:0:17844:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788846197.282758:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce462d7b/0x21b4d561382732f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754ab6 expref: 4 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846197.282794:0:17844:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e474532800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788846197.282815:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846197.282817:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846197.282819:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846197.283340:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+2:2397:x1875740683549568:12345-192.168.203.20@tcp:9:umount.0 Request processed in 1019us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846197.283349:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00080000:1.0:1788846197.283472:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846197.295293:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846197.295383:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683550464 00000100:00100000:3.0:1788846197.295392:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683550464 00000100:00100000:3.0:1788846197.295550:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:3.0:1788846197.295562:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+12:2397:x1875740683550464:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:3.0:1788846197.295593:0:17089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272f6d 00000020:00010000:3.0:1788846197.295607:0:17089:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90e342703800: total 0 00000100:00080000:3.0:1788846197.295612:0:17089:0:(import.c:65:import_set_state_nolock()) ffff90e342705800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788846197.295633:0:17089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:3.0:1788846197.295811:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+11:2397:x1875740683550464:12345-192.168.203.20@tcp:39:umount.0 Request processed in 251us (526us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1788846197.295819:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 76 00000020:00010000:0.0:1788846197.297578:0:17077:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90e342703800: total 0 00010000:00010000:0.0:1788846197.297637:0:17077:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e342703800, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1788846197.297674:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:0.0:1788846197.297677:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788846197.297686:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ce00/0x21b4d56138273299 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a93 expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846197.297713:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e45176f700) 00010000:00010000:0.0:1788846197.297715:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846197.297719:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138273054 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549e4 expref: 9 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846197.297734:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:0.0:1788846197.297736:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788846197.297752:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab000/0x21b4d56138273093 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549f2 expref: 8 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846197.297767:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:0.0:1788846197.297770:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788846197.297782:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0de00/0x21b4d5613827323e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a7e expref: 7 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846197.297796:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:0.0:1788846197.297807:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788846197.297825:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273302 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754abd expref: 6 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846197.297855:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90e46d443000) 00010000:00010000:0.0:1788846197.297858:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788846197.297862:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273038 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549dd expref: 5 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846197.297876:0:17077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:0.0:1788846197.297878:0:17077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788846197.297881:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273118 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a1c expref: 4 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846197.298097:0:17077:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e342703800, canceled 7 locks, left on hash table 0. 00010000:00010000:0.0:1788846197.298113:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846197.298115:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846197.298117:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788846197.299216:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846197.310999:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846197.311077:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683550592 00000100:00100000:3.0:1788846197.311087:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683550592 00000100:00100000:3.0:1788846197.311168:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:3.0:1788846197.311179:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2397:x1875740683550592:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:3.0:1788846197.311212:0:17088:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272f74 00000100:00080000:3.0:1788846197.311229:0:17088:0:(import.c:65:import_set_state_nolock()) ffff90e34366a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788846197.311260:0:17088:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788846197.311491:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+3:2397:x1875740683550592:12345-192.168.203.20@tcp:39:umount.0 Request processed in 313us (499us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788846197.311500:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00010000:00010000:0.0:1788846197.311633:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788846197.312233:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788846197.433750:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846197.615204:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846197.615271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846197.615407:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683550848 00000100:00100000:0.0:1788846197.615417:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683550848 00000100:00100000:0.0:1788846197.615483:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683550720 00000100:00100000:0.0:1788846197.615486:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683550720 00000100:00100000:0.0:1788846197.615514:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:0.0:1788846197.615558:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683550848:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846197.615623:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683550848:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 69us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846197.615630:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:0.0:1788846197.615646:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:0.0:1788846197.615652:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2400:x1875740683550720:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846197.615689:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2400:x1875740683550720:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 37us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846197.615695:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00080000:1.0:1788846197.616193:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788846197.616205:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1788846198.080331:0:19412:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e9c95b52-bf21-4a43-abed-5b176d36d076 00000020:00000080:2.0:1788846198.080340:0:19412:0:(genops.c:885:class_export_put()) final put ffff90e46e21d800/e9c95b52-bf21-4a43-abed-5b176d36d076 00000001:00100000:2.0:1788846198.080368:0:19412:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000020:00000080:2.0:1788846198.080379:0:19412:0:(genops.c:885:class_export_put()) final put ffff90e344594800/53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000020:00000080:1.0:1788846198.080457:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46e21d800/e9c95b52-bf21-4a43-abed-5b176d36d076 for lustre-OST0001 00000020:00000080:1.0:1788846198.080627:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e344594800/53da1059-0b4b-4ba8-a35c-806ac864d7eb for lustre-OST0001 00000020:00000080:1.0:1788846198.080646:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e46e21d000 for lustre-OST0001 00000020:00000080:1.0:1788846198.080651:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e344597000 for lustre-OST0001 00000001:00100000:3.0:1788846198.082336:0:18592:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000020:00000080:3.0:1788846198.082343:0:18592:0:(genops.c:885:class_export_put()) final put ffff90e474532800/53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000001:00100000:3.0:1788846198.082477:0:18592:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e9c95b52-bf21-4a43-abed-5b176d36d076 00000020:00000080:3.0:1788846198.082481:0:18592:0:(genops.c:885:class_export_put()) final put ffff90e46e21e800/e9c95b52-bf21-4a43-abed-5b176d36d076 00000020:00000080:1.0:1788846198.082579:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e474532800/53da1059-0b4b-4ba8-a35c-806ac864d7eb for lustre-OST0000 00000020:00000080:1.0:1788846198.083656:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46e21e800/e9c95b52-bf21-4a43-abed-5b176d36d076 for lustre-OST0000 00000020:00000080:1.0:1788846198.084012:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e474530800 for lustre-OST0000 00000020:00000080:1.0:1788846198.084017:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e46e21c800 for lustre-OST0000 00010000:00010000:0.0:1788846198.457697:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846199.129359:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846199.132837:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846199.139727:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846199.141367:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683550976 00000100:00100000:2.0:1788846199.141381:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683550976 00000100:00100000:0.0:1788846199.141672:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683551104 00000100:00100000:1.0:1788846199.141679:0:20117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683551232 00000100:00100000:0.0:1788846199.141679:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683551104 00000100:00100000:1.0:1788846199.141686:0:20117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683551232 00000100:00100000:1.0:1788846199.141736:0:20117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1788846199.141744:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1788846199.141750:0:20117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:2399:x1875740683551232:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788846199.141760:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:2398:x1875740683551104:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846199.141766:0:20117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846199.141781:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846199.141787:0:20117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2000/0x21b4d56138272fdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549cf expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846199.141798:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aaae00/0x21b4d56138272f9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754990 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846199.141805:0:20117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846199.141824:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846199.141868:0:20117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:2399:x1875740683551232:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 123us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846199.141876:0:20117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1788846199.141949:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:0.0:1788846199.142039:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+9:2398:x1875740683551104:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 282us (9219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846199.142071:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+9:2398:x1875740683550976:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846199.142081:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846199.142091:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aaa400/0x21b4d56138272f97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175495f expref: 9 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846199.142101:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846199.142120:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+8:2398:x1875740683550976:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 165us (12770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846199.143091:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:3.0:1788846199.143101:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1788846199.147750:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846199.148127:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683551488 00000100:00100000:0.0:1788846199.148142:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683551488 00000100:00100000:0.0:1788846199.148232:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:0.0:1788846199.148243:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2397:x1875740683551488:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:0.0:1788846199.148281:0:17089:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272fac 00000020:00010000:0.0:1788846199.148288:0:17089:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90e34295f000: total 0 00000100:00080000:0.0:1788846199.148293:0:17089:0:(import.c:65:import_set_state_nolock()) ffff90e34295e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788846199.148323:0:17089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00010000:2.0:1788846199.148410:0:17076:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90e34295f000: total 0 00010000:00010000:2.0:1788846199.148469:0:17076:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e34295f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788846199.148509:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:2.0:1788846199.148513:0:17076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846199.148541:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2600/0x21b4d561382730a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549f9 expref: 5 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846199.148567:0:17076:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e34295f000, canceled 1 locks, left on hash table 0. 00000100:00080000:1.0:1788846199.148579:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788846199.148581:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846199.148585:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846199.148587:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846199.149121:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+3:2397:x1875740683551488:12345-192.168.203.20@tcp:39:umount.0 Request processed in 876us (1382us total) trans 8589934638 rc 0/0 00000100:00100000:0.0:1788846199.149130:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:1.0:1788846199.161382:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846199.162886:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683551616 00000100:00100000:2.0:1788846199.162906:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683551616 00000100:00080000:1.0:1788846199.164204:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788846199.164535:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:2.0:1788846199.164578:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2397:x1875740683551616:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:2.0:1788846199.164632:0:18618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272fb3 00000100:00080000:2.0:1788846199.164646:0:18618:0:(import.c:65:import_set_state_nolock()) ffff90e474530000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788846199.164682:0:18618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788846199.164906:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+3:2397:x1875740683551616:12345-192.168.203.20@tcp:39:umount.0 Request processed in 337us (3537us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788846199.164916:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00010000:00010000:0.0:1788846199.165051:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846199.199147:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846199.200061:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683551872 00000100:00100000:2.0:1788846199.200076:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683551872 00000100:00100000:3.0:1788846199.200394:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 171 00000100:00100000:3.0:1788846199.200409:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+7:2397:x1875740683551872:12345-192.168.203.20@tcp:251:umount.0 00000020:00000080:3.0:1788846199.200473:0:17082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272f4a 00000020:00010000:3.0:1788846199.200483:0:17082:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90e46e21a000: total 0 00000100:00080000:3.0:1788846199.200489:0:17082:0:(import.c:65:import_set_state_nolock()) ffff90e46e218800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788846199.200624:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+3:2397:x1875740683551872:12345-192.168.203.20@tcp:251:umount.0 Request processed in 218us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846199.200633:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 171 00000020:00010000:1.0:1788846199.200713:0:17077:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90e46e21a000: total 0 00010000:00010000:1.0:1788846199.200718:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846199.200781:0:17077:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e46e21a000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788846199.200851:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aab600/0x21b4d56138272f51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548e8 expref: 2 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846199.200872:0:17077:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e46e21a000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788846199.200883:0:17077:0:(genops.c:885:class_export_put()) final put ffff90e46e21a000/a7b5cd26-e654-4a7c-b591-2ded2c0f1e54 00010000:00010000:1.0:1788846199.200897:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846199.200899:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846199.200900:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788846199.200913:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46e21a000/a7b5cd26-e654-4a7c-b591-2ded2c0f1e54 for MGS 00000020:00000080:1.0:1788846199.200968:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e46e218800 for MGS 00010000:00010000:2.0:1788846199.481836:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846200.122942:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702489856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846200.123045:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846200.123121:0:19095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702489856 00000100:00100000:3.0:1788846200.123132:0:19095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702489856 00000100:00100000:3.0:1788846200.124344:0:19095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788846200.124364:0:19095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702489856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788846200.124418:0:19095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788846200.124504:0:19095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702489856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846200.124512:0:19095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788846200.124560:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846200.124616:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702489856:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788846200.510366:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788846200.571662:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788846200.633839:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702489984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846200.633968:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846200.634587:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788846200.634606:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702490112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846200.634652:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846200.639113:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702489984 00000100:00100000:3.0:1788846200.639133:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702489984 00000100:00100000:2.0:1788846200.639465:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702490112 00000100:00100000:2.0:1788846200.639471:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702490112 00000100:00100000:2.0:1788846200.639849:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788846200.639863:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702490112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788846200.639918:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788846200.640149:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702490112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 287us (5495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846200.640157:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788846200.640222:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788846200.640230:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702489984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846200.640252:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788846200.640296:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702489984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (6330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846200.640304:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788846200.640656:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702489984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846200.640995:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702490112:0@lo:41:osp-pre-1-0.0 00000020:01000004:3.0:1788846200.818499:0:20660:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788846200.828838:0:20660:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788846200.828900:0:20660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.828915:0:20660:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.828923:0:20660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.828930:0:20660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.828959:0:20660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788846200.828965:0:20660:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788846200.828990:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788846200.829069:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788846200.829090:0:20660:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788846200.829114:0:20660:0:(import.c:65:import_set_state_nolock()) ffff90e47b581800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788846200.829184:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702490240:0@lo:39:umount.0 00000100:00100000:2.0:1788846200.829253:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846200.829350:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702490240 00000100:00100000:3.0:1788846200.829358:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702490240 00000100:00100000:3.0:1788846200.829413:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788846200.829424:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875740702490240:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788846200.829449:0:17090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272b3e 00000100:00080000:3.0:1788846200.829457:0:17090:0:(import.c:65:import_set_state_nolock()) ffff90e47518a000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788846200.829510:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1875740702490240:12345-0@lo:39:umount.0 Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846200.829545:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:3.0:1788846200.829556:0:17090:0:(genops.c:885:class_export_put()) final put ffff90e47518a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788846200.829581:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47518a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1788846200.829715:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846200.829724:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.829732:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846200.829736:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.829745:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846200.829752:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846200.829758:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788846200.829761:0:17077:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788846200.829763:0:17077:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788846200.829788:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.829795:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846200.829860:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788846200.829893:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47b581800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788846200.829904:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702490240:0@lo:39:umount.0 00000100:00080000:2.0:1788846200.829941:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788846200.829944:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788846200.829948:0:20660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788846200.830846:0:20660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846200.830859:0:20660:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846200.830866:0:20660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846200.830873:0:20660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846200.830891:0:20660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846200.830905:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846200.830910:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846200.830917:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846200.830920:0:17844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846200.830943:0:17844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846200.830950:0:17844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846200.830956:0:17844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788846200.830958:0:17844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788846200.830978:0:17844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846200.830984:0:17844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846200.831002:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846200.831009:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846200.831022:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846200.831024:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846200.831026:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846200.831039:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702490496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846200.831090:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788846200.831799:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47518a000 for lustre-MDT0000 00000100:00100000:1.0:1788846200.836258:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702490368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846200.836331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788846200.836539:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.836551:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.836579:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846200.836581:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846200.836583:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846200.837067:0:20660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837078:0:20660:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837086:0:20660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837092:0:20660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837117:0:20660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846200.837124:0:20660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837143:0:20660:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837149:0:20660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837155:0:20660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837170:0:20660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788846200.837176:0:20660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837182:0:20660:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837188:0:20660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837194:0:20660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.837203:0:20660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1788846200.837208:0:20660:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788846200.837212:0:20660:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788846200.837251:0:20660:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788846200.837255:0:20660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788846200.837260:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846200.837266:0:20660:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788846200.837276:0:20660:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90e342702000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788846200.837282:0:20660:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90e34363f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788846200.837286:0:20660:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90e47d36c000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788846200.837291:0:20660:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90e451415000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788846200.837298:0:20660:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90e34295f000 e9c95b52-bf21-4a43-abed-5b176d36d076 192.168.203.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1788846200.837302:0:20660:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90e342703800 53da1059-0b4b-4ba8-a35c-806ac864d7eb 192.168.203.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:3.0:1788846200.837307:0:20660:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90e4752ecd28) has exports, disconnecting them 00000020:00080000:3.0:1788846200.837312:0:20660:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90e342702000), last request at 1788846196 00000020:00000080:3.0:1788846200.837319:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272d75 00000100:00080000:3.0:1788846200.837334:0:20660:0:(import.c:65:import_set_state_nolock()) ffff90e342707800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788846200.837380:0:20660:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e342702000): rc 0 00000020:00000080:3.0:1788846200.837383:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e342702000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788846200.837394:0:20660:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90e34363f800), last request at 1788846196 00000020:00000080:3.0:1788846200.837398:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272cdb 00000100:00080000:3.0:1788846200.837403:0:20660:0:(import.c:65:import_set_state_nolock()) ffff90e343639800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788846200.837410:0:20660:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e34363f800): rc 0 00000020:00000080:3.0:1788846200.837412:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e34363f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788846200.837415:0:20660:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90e47d36c000), last request at 1788846128 00000020:00000080:3.0:1788846200.837418:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272c2c 00000100:00080000:3.0:1788846200.837421:0:20660:0:(import.c:65:import_set_state_nolock()) ffff90e447150800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788846200.837426:0:20660:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e47d36c000): rc 0 00000020:00000080:3.0:1788846200.837427:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e47d36c000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788846200.837431:0:20660:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90e451415000), last request at 1788846128 00000020:00000080:3.0:1788846200.837434:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272bd1 00000100:00080000:3.0:1788846200.837437:0:20660:0:(import.c:65:import_set_state_nolock()) ffff90e47b580800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788846200.837443:0:20660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:3.0:1788846200.837514:0:20660:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e451415000): rc 0 00000004:00000080:3.0:1788846200.837542:0:20660:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb1f087dd3ae0 00000100:00080000:3.0:1788846200.837561:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788846200.837565:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788846200.837706:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788846200.837713:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837721:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846200.837724:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837732:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846200.837738:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846200.837743:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788846200.837745:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788846200.837747:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788846200.837776:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837783:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788846200.837801:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837818:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837840:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788846200.837844:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837849:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846200.837852:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837859:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846200.837864:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846200.837869:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788846200.837870:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788846200.837872:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788846200.837886:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837892:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788846200.837899:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837904:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837913:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846200.837915:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837927:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065200 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846200.837929:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837935:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846200.837941:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846200.837945:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788846200.837947:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788846200.837949:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788846200.837961:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837966:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788846200.837971:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837977:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846200.837985:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846200.837987:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846200.837988:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846200.838012:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702490624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788846200.838065:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846200.838637:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788846200.841202:0:20660:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788846200.841235:0:20660:0:(import.c:65:import_set_state_nolock()) ffff90e451763800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788846200.841801:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702490880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846200.841869:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846200.841890:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846200.841897:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702490752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846200.841942:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788846200.841987:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342702000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1788846200.842143:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702490496 00000100:00100000:3.0:1788846200.842152:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702490496 00000100:00100000:3.0:1788846200.842200:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702490368 00000100:00100000:3.0:1788846200.842203:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702490368 00000100:00100000:3.0:1788846200.842217:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702490880 00000100:00100000:3.0:1788846200.842220:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702490880 00000100:00100000:3.0:1788846200.842232:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702490752 00000100:00100000:3.0:1788846200.842235:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702490752 00000100:00100000:3.0:1788846200.842251:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788846200.842260:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f27e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+27:3642:x1875740702490496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846200.842273:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846200.842295:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138272a65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272a5e expref: 27 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.842313:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846200.842354:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f27e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+26:3642:x1875740702490496:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (11262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846200.842362:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788846200.842404:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788846200.842410:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+25:3641:x1875740702490368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846200.842417:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846200.842425:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475064200/0x21b4d56138272b14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272b0d expref: 25 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.842446:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846200.842475:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3641:x1875740702490368:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (6145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846200.842481:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788846200.842494:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788846200.842500:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:3641:x1875740702490880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846200.842506:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846200.842514:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e3400/0x21b4d56138272a57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272a50 expref: 23 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.842546:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846200.842568:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:3641:x1875740702490880:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846200.842574:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788846200.842586:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788846200.842592:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:3641:x1875740702490752:12345-0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788846200.843757:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34363f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788846200.843783:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d36c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788846200.843816:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342707800 for lustre-MDT0000 00000020:00000080:1.0:1788846200.843822:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e343639800 for lustre-MDT0000 00000020:00000080:1.0:1788846200.843827:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e447150800 for lustre-MDT0000 00000100:00100000:1.0:1788846200.843900:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702490880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846200.843913:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702490368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846200.844305:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702491008:0@lo:39:umount.0 00000100:00100000:2.0:1788846200.844363:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788846200.844709:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846200.844731:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aaa000/0x21b4d5613827301c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138273015 expref: 21 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.844746:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846200.844785:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:3641:x1875740702490752:12345-0@lo:103:ldlm_bl.0 Request processed in 2193us (2842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846200.844794:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788846200.844884:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788846200.844889:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1788846200.844914:0:20660:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788846200.844979:0:20660:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788846200.845000:0:20660:0:(import.c:65:import_set_state_nolock()) ffff90e44314f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788846200.845014:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788846200.845016:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1788846200.845024:0:20660:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788846200.845078:0:20660:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788846200.845087:0:20660:0:(import.c:65:import_set_state_nolock()) ffff90e47f491000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788846200.845126:0:20660:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90e4752ecd28) has no exports 00000100:00100000:0.0:1788846200.845212:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846200.845303:0:20117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702490624 00000100:00100000:3.0:1788846200.845310:0:20117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702490624 00000100:00100000:1.0:1788846200.845416:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702491008 00000100:00100000:1.0:1788846200.845427:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702491008 00000100:00100000:1.0:1788846200.845460:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788846200.845468:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875740702491008:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788846200.845496:0:17093:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272c56 00000100:00080000:1.0:1788846200.845504:0:17093:0:(import.c:65:import_set_state_nolock()) ffff90e3424f7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788846200.845540:0:17093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788846200.845687:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3639:x1875740702491008:12345-0@lo:39:umount.0 Request processed in 219us (1324us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788846200.845694:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1788846200.845767:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846200.845792:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702490752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846200.846181:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702491136:0@lo:9:umount.0 00000100:00100000:2.0:1788846200.846239:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846200.846392:0:20117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788846200.846403:0:20117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:3643:x1875740702490624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846200.846415:0:20117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846200.846434:0:20117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272dc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272dbb expref: 20 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846200.846448:0:20117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846200.846487:0:20117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:3643:x1875740702490624:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846200.846494:0:20117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788846200.846608:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702491264:0@lo:9:umount.0 00000100:00100000:2.0:1788846200.846633:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846200.847103:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702490624:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788846200.847833:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e451763800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788846200.847843:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702491008:0@lo:39:umount.0 00000100:00100000:2.0:1788846200.847894:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702490496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846200.848038:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702491136 00000100:00100000:1.0:1788846200.848044:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702491136 00000100:00100000:3.0:1788846200.848114:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702491264 00000100:00100000:3.0:1788846200.848119:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702491264 00000100:00100000:1.0:1788846200.848171:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788846200.848179:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875740702491136:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788846200.848202:0:18595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272da6 00000100:00080000:1.0:1788846200.848209:0:18595:0:(import.c:65:import_set_state_nolock()) ffff90e342705000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788846200.848249:0:18595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788846200.848384:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3639:x1875740702491136:12345-0@lo:9:umount.0 Request processed in 205us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846200.848392:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788846200.848411:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788846200.848465:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788846200.848470:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788846200.848495:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e44314f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788846200.848507:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788846200.848510:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846200.848513:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702491136:0@lo:9:umount.0 00000100:00100000:2.0:1788846200.849225:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788846200.849235:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1875740702491264:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788846200.849252:0:19458:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272dad 00000100:00080000:2.0:1788846200.849259:0:19458:0:(import.c:65:import_set_state_nolock()) ffff90e34363b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788846200.849365:0:19458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788846200.849497:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3639:x1875740702491264:12345-0@lo:9:umount.0 Request processed in 264us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846200.849504:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788846200.849593:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47f491000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788846200.849618:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788846200.849620:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788846200.849624:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702491264:0@lo:9:umount.0 00010000:00010000:1.0:1788846200.849872:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788846200.854999:0:20660:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90e4752ecd28) has no exports 00000020:00000080:1.0:1788846200.902510:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272aab 00000020:00000080:1.0:1788846200.902675:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e47d36b000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788846200.902743:0:20660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788846200.902829:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846200.902842:0:20660:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788846200.902848:0:20660:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90e341e50000) has no exports 00000020:00000080:0.0:1788846200.903133:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272aa4 00000020:00000080:0.0:1788846200.903139:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e4437d6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788846200.903319:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d36b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788846200.903869:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4437d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788846200.903937:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846200.903946:0:20660:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788846200.903950:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e46e318800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788846200.903952:0:20660:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46e318800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788846200.903961:0:20660:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1788846201.529739:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846201.658067:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702491520:0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.658150:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846201.658340:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702491648:0@lo:400:kworker.0 00000100:00100000:1.0:1788846201.658371:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846201.658399:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702492160:0@lo:400:kworker.0 00000100:00100000:1.0:1788846201.658422:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846201.658447:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788846201.658453:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702491776:0@lo:400:kworker.0 00000100:00100000:1.0:1788846201.658486:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846201.658501:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702492288:0@lo:400:kworker.0 00000100:00100000:1.0:1788846201.658539:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846201.658581:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702492160 00000100:00100000:1.0:1788846201.658588:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702492160 00000100:00100000:1.0:1788846201.658646:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702492288 00000100:00100000:1.0:1788846201.658649:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702492288 00000100:00100000:1.0:1788846201.658669:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788846201.658677:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702492160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846201.658727:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702492160:12345-0@lo:400:kworker.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846201.658735:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788846201.658752:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788846201.658756:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875740702492288:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788846201.658762:0:17088:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788846201.658785:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875740702492288:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788846201.658809:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788846201.658829:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702491648 00000100:00100000:1.0:1788846201.658832:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702491648 00000100:00100000:1.0:1788846201.658853:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702491776 00000100:00100000:1.0:1788846201.658869:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702491776 00000100:00100000:1.0:1788846201.658894:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788846201.658900:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702491648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846201.658931:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702491648:12345-0@lo:400:kworker.0 Request processed in 32us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846201.658937:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788846201.658949:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788846201.658954:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702491776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846201.658979:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702491776:12345-0@lo:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846201.658985:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788846201.659003:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788846201.659007:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788846201.659032:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702491776:0@lo:400:kworker.0 00000100:00080000:1.0:1788846201.659044:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788846201.659048:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90e46e21a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788846201.659051:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788846201.660237:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702492032:0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.660285:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846201.660316:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702492544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788846201.660326:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702491520 00000100:00100000:2.0:1788846201.660332:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702491520 00000100:00100000:3.0:1788846201.660357:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846201.660370:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788846201.660376:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875740702491520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.660378:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000020:00080000:2.0:1788846201.660383:0:17094:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788846201.660384:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702491392:0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.660411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846201.660417:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1875740702491520:12345-0@lo:400:kworker.0 Request processed in 40us (2267us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788846201.660424:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788846201.660434:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702491904:0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.660456:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846201.660476:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702492416:0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.660496:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788846201.660514:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788846201.660536:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e343be0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788846201.660540:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788846201.660546:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e343be0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846201.660561:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:3.0:1788846201.660566:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90e343be0000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846201.660592:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745ce680 x1875740702492672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846201.660636:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702491520:0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.660664:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702492032 00000100:00100000:3.0:1788846201.660668:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702492032 00000100:00100000:3.0:1788846201.660686:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702491904 00000100:00100000:3.0:1788846201.660688:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702491904 00000100:00100000:3.0:1788846201.660697:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702492416 00000100:00100000:3.0:1788846201.660699:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702492416 00000100:00100000:3.0:1788846201.660726:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788846201.660733:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702492416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.660770:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702492416:12345-0@lo:400:kworker.0 Request processed in 39us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846201.660777:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788846201.660783:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788846201.660787:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788846201.660791:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875740702491904:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788846201.660795:0:17090:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788846201.660832:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875740702491904:12345-0@lo:400:kworker.0 Request processed in 40us (375us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788846201.660838:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788846201.660858:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875740702492032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.660859:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702492544 00000100:00100000:3.0:1788846201.660862:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702492544 00000020:00080000:2.0:1788846201.660864:0:18618:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788846201.660885:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788846201.660889:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1875740702492032:12345-0@lo:400:kworker.0 Request processed in 100us (604us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788846201.660891:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702492544:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788846201.660895:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00002000:00000024:3.0:1788846201.660911:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788846201.660943:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702492544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846201.660949:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788846201.660975:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702491392 00000100:00100000:3.0:1788846201.660979:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702491392 00000100:00080000:2.0:1788846201.661002:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846201.661009:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788846201.661013:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702492672:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788846201.661016:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:3643:x1875740702491392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846201.661040:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846201.661043:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:3643:x1875740702491392:12345-0@lo:400:kworker.0 Request processed in 29us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846201.661049:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788846201.661066:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702492672 00000100:00100000:2.0:1788846201.661070:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702492672 00000100:00100000:2.0:1788846201.661088:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788846201.661092:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1875740702492672:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788846201.661096:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702491392:0@lo:400:kworker.0 00000100:00080000:3.0:1788846201.661104:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00010000:02000000:2.0:1788846201.661105:0:17829:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788846201.661107:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e47f495800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788846201.661110:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788846201.661114:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e47f495800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846201.661116:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:3.0:1788846201.661120:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90e47f495800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846201.663739:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745cea00 x1875740702492800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846201.663880:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702491904:0@lo:400:kworker.0 00010000:00080000:3.0:1788846201.663910:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b2d80 x1875740702492416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846201.663921:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702492416:0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.663943:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702492544:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788846201.663955:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788846201.663959:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e34363a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788846201.663976:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788846201.663981:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e34363a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846201.663985:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1788846201.663992:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90e34363a000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846201.664018:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745cfb80 x1875740702492928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846201.664028:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702492032:0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.665359:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702492800:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788846201.665433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846201.666161:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702492928:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788846201.666691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846201.667250:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702492800 00000100:00100000:3.0:1788846201.667258:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702492800 00000100:00100000:3.0:1788846201.667290:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702492928 00000100:00100000:3.0:1788846201.667291:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702492928 00000100:00100000:3.0:1788846201.667302:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788846201.667308:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702492800:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788846201.667324:0:17090:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788846201.667364:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702492800:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 55us (1931us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788846201.667371:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788846201.667385:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788846201.667388:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702492928:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788846201.667394:0:17090:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788846201.667413:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702492928:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 24us (723us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788846201.667429:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788846201.667471:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47f495800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846201.667476:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788846201.667480:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702492800:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788846201.667490:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e34363a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846201.667493:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788846201.667496:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702492928:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788846201.679930:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90e46e21a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846201.679941:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 543 00000100:00080000:1.0:1788846201.679951:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90e46e21a800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846201.679992:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474541c00 x1875740702493056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846201.680028:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702492288:0@lo:400:kworker.0 00000100:00100000:1.0:1788846201.680065:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702491648:0@lo:400:kworker.0 00010000:00080000:1.0:1788846201.680098:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1180 x1875740702492160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846201.680108:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702492160:0@lo:400:kworker.0 00000100:00100000:3.0:1788846201.680888:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702493056:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788846201.680956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846201.681100:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702493056 00000100:00100000:0.0:1788846201.681107:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702493056 00000100:00100000:0.0:1788846201.681151:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788846201.681158:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702493056:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788846201.681302:0:17090:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788846201.681378:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702493056:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 219us (421us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788846201.681386:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788846201.681635:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e46e21a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846201.681642:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788846201.681646:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702493056:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788846201.695401:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1875740702492672:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 34300us (34353us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788846201.695414:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788846201.695562:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343be0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846201.695568:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788846201.695573:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702492672:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1788846202.553724:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788846202.684109:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788846202.684118:0:17068:0:(genops.c:885:class_export_put()) final put ffff90e451415000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788846202.684137:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e9c95b52-bf21-4a43-abed-5b176d36d076 00000001:00080000:3.0:1788846202.684145:0:17068:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:3.0:1788846202.684149:0:17068:0:(genops.c:885:class_export_put()) final put ffff90e34295f000/e9c95b52-bf21-4a43-abed-5b176d36d076 00000001:00100000:3.0:1788846202.684153:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000001:00080000:3.0:1788846202.684156:0:17068:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:3.0:1788846202.684158:0:17068:0:(genops.c:885:class_export_put()) final put ffff90e342703800/53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000020:00000080:2.0:1788846202.684271:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e451415000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788846202.684326:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34295f000/e9c95b52-bf21-4a43-abed-5b176d36d076 for lustre-MDT0000 00000020:00000080:2.0:1788846202.684361:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342703800/53da1059-0b4b-4ba8-a35c-806ac864d7eb for lustre-MDT0000 00000020:00000080:2.0:1788846202.684383:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47b580800 for lustre-MDT0000 00000020:00000080:2.0:1788846202.684388:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e34295e000 for lustre-MDT0000 00000020:00000080:2.0:1788846202.684391:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342705800 for lustre-MDT0000 00000001:00100000:2.0:1788846202.686733:0:17821:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788846202.686748:0:17821:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1788846202.686753:0:17821:0:(genops.c:885:class_export_put()) final put ffff90e447168000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788846202.686782:0:17821:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e9c95b52-bf21-4a43-abed-5b176d36d076 00000001:00080000:2.0:1788846202.686809:0:17821:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1788846202.686812:0:17821:0:(genops.c:885:class_export_put()) final put ffff90e474533800/e9c95b52-bf21-4a43-abed-5b176d36d076 00000001:00100000:2.0:1788846202.686818:0:17821:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000001:00080000:2.0:1788846202.686823:0:17821:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1788846202.686825:0:17821:0:(genops.c:885:class_export_put()) final put ffff90e344561800/53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000020:00000080:1.0:1788846202.686835:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e447168000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788846202.686893:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e474533800/e9c95b52-bf21-4a43-abed-5b176d36d076 for lustre-MDT0001 00000020:00000080:1.0:1788846202.686922:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e344561800/53da1059-0b4b-4ba8-a35c-806ac864d7eb for lustre-MDT0001 00000020:00000080:1.0:1788846202.686943:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e3424f7000 for lustre-MDT0001 00000020:00000080:1.0:1788846202.686947:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e474530000 for lustre-MDT0001 00000020:00000080:1.0:1788846202.686950:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e34366a000 for lustre-MDT0001 00000020:01000000:0.0:1788846202.937640:0:20660:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e341ea7840 - data ffff90e478a3e000/ffff90e342442000 00000020:01000000:0.0:1788846202.937810:0:20660:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e469b5a180 - data ffff90e44ba46360/ffff90e47d5ce000 00000001:00000004:0.0:1788846202.943880:0:20660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:1.0:1788846203.002683:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788846203.002692:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788846203.002707:0:20660:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff90e344576a00 x1875740702491008/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788846210 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846203.002745:0:20660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788846203.005499:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788846203.005506:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1788846203.005543:0:20660:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788846203.005545:0:20660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788846203.006351:0:17112:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788846203.006357:0:17112:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1788846203.006368:0:17112:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788846203.007460:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788846203.007466:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788846203.007479:0:20660:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788846203.007481:0:20660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788846203.012055:0:17114:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788846203.012064:0:17114:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1788846203.012080:0:17114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788846203.014950:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272a73 00000020:00000080:1.0:1788846203.014962:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e451764000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788846203.015105:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e451764000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788846203.018494:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272a88 00000020:00000080:1.0:1788846203.018508:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e4752fc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788846203.018585:0:20660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788846203.018591:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846203.018599:0:20660:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788846203.018604:0:20660:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90e4752e8000) has no exports 00000004:01000000:1.0:1788846203.018762:0:20660:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788846203.018770:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272aea 00000020:00000080:1.0:1788846203.018774:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e44314d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788846203.020332:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4752fc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788846203.020660:0:20660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788846203.020735:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e44314d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788846203.020756:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846203.020764:0:20660:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788846203.020768:0:20660:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff90e342658000) has no exports 00000020:00000080:1.0:1788846203.020775:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272ae3 00000020:00000080:1.0:1788846203.020783:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e47f497800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788846203.020842:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47f497800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788846203.021170:0:20660:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788846203.021174:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788846203.021178:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788846203.021183:0:20660:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788846203.021185:0:20660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788846203.022332:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788846203.022344:0:20660:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788846203.022352:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272ad5 00000020:00000080:1.0:1788846203.022359:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e47d36e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788846203.023989:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47f491000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788846203.024006:0:16008:0:(genops.c:885:class_export_put()) final put ffff90e47d36f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788846203.024024:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d36f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788846203.024032:0:16008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788846203.024361:0:20660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788846203.024367:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846203.024376:0:20660:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788846203.024380:0:20660:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff90e341e53370) has no exports 00000020:00000080:1.0:1788846203.024387:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272ace 00000020:00000080:1.0:1788846203.024393:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e46e31e800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788846203.025423:0:20660:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788846203.025436:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788846203.025440:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788846203.025446:0:20660:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788846203.025449:0:20660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788846203.025537:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788846203.025545:0:20660:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788846203.025561:0:20660:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788846203.025566:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272ac0 00000020:00000080:1.0:1788846203.025571:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e47d36a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788846203.025663:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d36e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788846203.025777:0:20660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788846203.025782:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846203.025787:0:20660:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788846203.025800:0:20660:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff90e3438799b8) has no exports 00000020:00000080:1.0:1788846203.025806:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272ab9 00000020:00000080:1.0:1788846203.025810:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e47d368000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788846203.026888:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46e31e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788846203.026898:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e44314f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788846203.026905:0:16008:0:(genops.c:885:class_export_put()) final put ffff90e47d36b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788846203.026907:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d36b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788846203.026911:0:16008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788846203.026979:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d36a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788846203.026984:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d368000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788846203.032588:0:20660:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788846203.032596:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788846203.032600:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788846203.032609:0:20660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788846203.032671:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846203.032683:0:20660:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788846203.032718:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846203.032722:0:20660:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788846203.032727:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e451767000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788846203.032732:0:20660:0:(genops.c:844:class_export_destroy()) destroying export ffff90e451767000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788846203.032743:0:20660:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788846203.032855:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272a8f 00000020:00000080:2.0:1788846203.032861:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e4752fe000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788846203.032866:0:20660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788846203.032870:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846203.032874:0:20660:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788846203.032878:0:20660:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90e4752e99b8) has no exports 00000020:00000080:2.0:1788846203.032908:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846203.032912:0:20660:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788846203.032916:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272a96 00000020:00000080:2.0:1788846203.032919:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e4752fc800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788846203.032927:0:20660:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e344550800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788846203.032930:0:20660:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e344550800 3 00000020:01000004:2.0:1788846203.032933:0:20660:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90e344550800 from lustre-MDT0000 00000020:00000080:2.0:1788846203.032951:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846203.032954:0:20660:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788846203.032957:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e451766000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788846203.032959:0:20660:0:(genops.c:844:class_export_destroy()) destroying export ffff90e451766000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788846203.032966:0:20660:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788846203.032997:0:20660:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788846203.033001:0:20660:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788846203.033003:0:20660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788846203.033006:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846203.033009:0:20660:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788846203.033016:0:20660:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90e34377b000 6db0807f-6150-4b75-b37b-0ed71f62ed94 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788846203.033021:0:20660:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff90e34387cd28) has exports, disconnecting them 00000020:00080000:2.0:1788846203.033025:0:20660:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90e34377b000), last request at 1788846115 00000020:00000080:2.0:1788846203.033038:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272a3b 00000020:00010000:2.0:1788846203.033042:0:20660:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90e34377b000: total 2 00000100:00080000:2.0:1788846203.033046:0:20660:0:(import.c:65:import_set_state_nolock()) ffff90e343778000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788846203.033064:0:20660:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e34377b000): rc 0 00000020:00080000:2.0:1788846203.033068:0:20660:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff90e34387cd28) has no exports 00000100:00100000:3.0:1788846203.033234:0:17082:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff90e47b637a00:17082] 1 exiting: rc = 0 00000100:00100000:3.0:1788846203.033326:0:17083:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90e47b636000:17083] 2 exiting: rc = 0 00000100:00100000:0.0:1788846203.033381:0:17080:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff90e47d09e600:17080] 0 exiting: rc = 1 00000100:00100000:2.0:1788846203.033497:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033508:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033516:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033542:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033548:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033554:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033562:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033577:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033585:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033594:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033603:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033612:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033619:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033626:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033636:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033646:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033655:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033661:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033666:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033674:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033681:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033686:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033759:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033766:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033771:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033776:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033782:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033787:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033802:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033808:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033813:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033818:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033823:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033828:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033834:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033839:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033845:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033850:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033855:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033860:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033865:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033869:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033882:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033888:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033893:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033899:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033904:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033909:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033913:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033918:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033923:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033928:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033933:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033938:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033944:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033949:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033955:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033960:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033965:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033970:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033976:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033981:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033987:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846203.033992:0:20660:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788846203.034837:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e451763800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788846203.034847:0:16008:0:(genops.c:885:class_export_put()) final put ffff90e47d36a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788846203.034849:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d36a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788846203.034854:0:16008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788846203.034916:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4752fe000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788846203.034920:0:16008:0:(genops.c:885:class_export_put()) final put ffff90e4752fa000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788846203.034922:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4752fa000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788846203.034925:0:16008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788846203.034948:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4752fc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1788846203.035189:0:17844:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90e34377b000: total 0 00010000:00010000:1.0:1788846203.035228:0:17844:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e34377b000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788846203.035324:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475065c00/0x21b4d56138272c9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272c95 expref: 14 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.035407:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138272b5a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272b53 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.035427:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e441356c00/0x21b4d56138272cc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272cbf expref: 12 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.035439:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e441357a00/0x21b4d56138272ff2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272feb expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.035452:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42de00/0x21b4d56138272c17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272c10 expref: 10 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.035479:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2800/0x21b4d56138272b68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272b61 expref: 9 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.035977:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e441356200/0x21b4d56138273000 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272ff9 expref: 8 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.035991:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e441356e00/0x21b4d56138272b76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272b6f expref: 7 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.036095:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e3600/0x21b4d56138272a49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272a42 expref: 6 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.036105:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272d36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272d2f expref: 5 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.036115:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e441357c00/0x21b4d56138272d9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272d98 expref: 4 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.036126:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475065400/0x21b4d56138272d60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138272d59 expref: 3 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.036138:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aab200/0x21b4d5613827300e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138273007 expref: 2 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846203.036149:0:17844:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e34377b000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788846203.036171:0:17844:0:(genops.c:885:class_export_put()) final put ffff90e34377b000/6db0807f-6150-4b75-b37b-0ed71f62ed94 00010000:00010000:1.0:1788846203.036221:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846203.036224:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846203.036226:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788846203.036552:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34377b000/6db0807f-6150-4b75-b37b-0ed71f62ed94 for MGS 00000020:00000080:3.0:1788846203.036583:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e343778000 for MGS 00000020:01000000:2.0:1788846203.036653:0:20660:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e343892f00 - data ffff90e449f1c510/ffff90e3434c2400 00000020:01000000:2.0:1788846203.036874:0:20660:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e442fd2780 - data ffff90e478b2a948/ffff90e343bd1c00 00000020:00000080:2.0:1788846203.037544:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272a1f 00000020:00000080:2.0:1788846203.037553:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e344554800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788846203.037577:0:20660:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e344550800 from MGS, refs=2 00000020:01000004:2.0:1788846203.037580:0:20660:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e344550800 2 00000020:01000004:2.0:1788846203.037583:0:20660:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90e344550800 from MGS 00000020:00000080:2.0:1788846203.037604:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846203.037611:0:20660:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788846203.037614:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e344550000/MGS 00000020:00000080:2.0:1788846203.037616:0:20660:0:(genops.c:844:class_export_destroy()) destroying export ffff90e344550000/MGS for MGS 00000020:01000000:2.0:1788846203.037622:0:20660:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788846203.037680:0:20660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788846203.037684:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846203.037689:0:20660:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788846203.037694:0:20660:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90e47b584800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788846203.037700:0:20660:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff90e341e519b8) has exports, disconnecting them 00000020:00080000:2.0:1788846203.037868:0:20660:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90e47b584800), last request at 1788846115 00000020:00000080:2.0:1788846203.037874:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272b22 00000020:00080000:2.0:1788846203.037884:0:20660:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e47b584800): rc 0 00000020:00000080:2.0:1788846203.037888:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e47b584800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788846203.038688:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e344554800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788846203.038700:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47b584800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788846203.039621:0:20660:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788846203.039626:0:20660:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788846203.039643:0:20660:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788846203.039649:0:20660:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846203.039671:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47b581800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788846203.039850:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846203.039858:0:20660:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788846203.039862:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e44314c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788846203.039865:0:20660:0:(genops.c:844:class_export_destroy()) destroying export ffff90e44314c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788846203.039869:0:20660:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788846203.039938:0:20660:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e344550800 1 00000020:00000080:3.0:1788846203.039960:0:20660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272a11 00000020:00000080:3.0:1788846203.039966:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e344555800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788846203.039983:0:20660:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788846203.040060:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e344555800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788846203.040072:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846203.040076:0:20660:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788846203.040080:0:20660:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90e343878000) has no exports 00000020:00000080:3.0:1788846203.123434:0:20660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846203.123447:0:20660:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788846203.123452:0:20660:0:(genops.c:885:class_export_put()) final put ffff90e344554000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788846203.123457:0:20660:0:(genops.c:844:class_export_destroy()) destroying export ffff90e344554000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788846203.123478:0:20660:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788846203.124010:0:20660:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90e344552000 00000020:02000400:3.0:1788846203.124075:0:20660:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788846203.579443:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846204.608566:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846205.241730:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702493184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788846205.241934:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846205.242096:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702493184 00000100:00100000:3.0:1788846205.242107:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702493184 00000100:00080000:1.0:1788846205.242179:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846205.242449:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788846205.242470:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702493184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788846205.242501:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788846205.243018:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702493184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 546us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846205.243026:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788846205.243079:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702493184:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788846205.625839:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788846206.582041:0:20861:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788846206.590635:0:20861:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788846206.590691:0:20861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.590706:0:20861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.590714:0:20861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.591015:0:20861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.591040:0:20861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846206.591470:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846206.591478:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846206.591486:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356a00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846206.591490:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846206.591498:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846206.591505:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846206.591510:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788846206.591541:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:1.0:1788846206.591575:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846206.591582:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846206.591605:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846206.591611:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846206.591624:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846206.591626:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846206.591627:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846206.591644:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702493312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846206.591705:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846206.591784:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702493312 00000100:00100000:1.0:1788846206.591791:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702493312 00000100:00100000:1.0:1788846206.591830:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788846206.591837:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1875740702493312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788846206.591844:0:17074:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788846206 with bad export cookie 2428800712590174779 10000000:01000000:0.0:1788846206.592592:0:20861:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:0.0:1788846206.592598:0:20861:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788846206.592626:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846206.592630:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788846206.592636:0:20861:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788846206.592642:0:20861:0:(import.c:65:import_set_state_nolock()) ffff90e47f495800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788846206.592647:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846206.592649:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788846206.592651:0:20861:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788846206.594134:0:20861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.594150:0:20861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.594158:0:20861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.594165:0:20861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.594421:0:20861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846206.594431:0:20861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.594457:0:20861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.594463:0:20861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.594470:0:20861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846206.594504:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846206.594512:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846206.594537:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42ca00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846206.594541:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846206.594557:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846206.594563:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846206.594568:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788846206.594570:0:17077:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788846206.594601:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846206.594606:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846206.594627:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846206.594633:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846206.594645:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846206.594648:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846206.594654:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846206.594657:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846206.594662:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846206.594668:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846206.594680:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788846206.594682:0:17077:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788846206.594693:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846206.594698:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846206.594704:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846206.594710:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846206.594712:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846206.594713:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846206.594730:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702493568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846206.594802:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846206.594849:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788846206.594856:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702493440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846206.594880:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846206.594909:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702493568 00000100:00100000:3.0:1788846206.594916:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702493568 00000100:00100000:3.0:1788846206.594937:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702493440 00000100:00100000:3.0:1788846206.594940:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702493440 00000100:00100000:3.0:1788846206.594952:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788846206.594959:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875740702493568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788846206.594965:0:17075:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788846206 with bad export cookie 2428800712590174779 00000100:00100000:3.0:1788846206.595005:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875740702493568:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (202us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788846206.595011:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788846206.595028:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788846206.595038:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f27d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875740702493440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788846206.595043:0:17075:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788846206 with bad export cookie 2428800712590174779 00000100:00100000:3.0:1788846206.595081:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f27d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875740702493440:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (200us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788846206.595087:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788846206.595118:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788846206.595123:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e450e6a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788846206.595127:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788846206.595189:0:20861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788846206.595205:0:20861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846206.595442:0:20861:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788846206.595475:0:20861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.595483:0:20861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.595490:0:20861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.595497:0:20861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.595542:0:20861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846206.595548:0:20861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.595564:0:20861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.595570:0:20861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.595575:0:20861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.595585:0:20861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788846206.595588:0:20861:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788846206.595595:0:20861:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788846206.595619:0:20861:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788846206.595623:0:20861:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788846206.595627:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846206.595632:0:20861:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788846206.595637:0:20861:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff90e342701800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788846206.595643:0:20861:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff90e446115000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788846206.595648:0:20861:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff90e3426599b8) has exports, disconnecting them 00000020:00080000:0.0:1788846206.595653:0:20861:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90e342701800), last request at 1788846201 00000020:00000080:0.0:1788846206.595659:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272d8a 00000100:00080000:0.0:1788846206.595672:0:20861:0:(import.c:65:import_set_state_nolock()) ffff90e342706800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788846206.595709:0:20861:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e342701800): rc 0 00000020:00000080:0.0:1788846206.595711:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e342701800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788846206.595721:0:20861:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90e446115000), last request at 1788846201 00000020:00000080:0.0:1788846206.595724:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272cf0 00000100:00080000:0.0:1788846206.595729:0:20861:0:(import.c:65:import_set_state_nolock()) ffff90e344566000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788846206.595742:0:20861:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e446115000): rc 0 00000020:00000080:0.0:1788846206.595744:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e446115000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788846206.595751:0:20861:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb1f081cc7ae0 00000100:00080000:0.0:1788846206.595777:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846206.595780:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788846206.596368:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846206.596376:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846206.596384:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846206.596388:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846206.596395:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846206.596401:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846206.596406:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788846206.596409:0:17077:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788846206.596411:0:17077:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:0.0:1788846206.596831:0:20861:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788846206.596837:0:20861:0:(import.c:65:import_set_state_nolock()) ffff90e343be0000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788846206.596872:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846206.596878:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.596885:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846206.596889:0:17844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.596896:0:17844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846206.596903:0:17844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846206.596909:0:17844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788846206.596912:0:17844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788846206.596914:0:17844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788846206.599669:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846206.599755:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1875740702493312:12345-0@lo:103:ldlm_bl.0 Request processed in 7913us (8046us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788846206.599779:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788846206.599842:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788846206.610510:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.120@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788846206.610515:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788846206.610541:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e474541500 x1875740702493312/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788846222 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846206.610556:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e4745cd500 x1875740702493568/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788846222 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846206.610565:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e4745cea00 x1875740702493440/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788846222 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788846206.610665:0:17844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.610675:0:17844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788846206.610702:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.610729:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846206.610753:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846206.610755:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846206.610757:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788846206.610889:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788846206.610893:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788846206.610894:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788846206.610898:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e450e6a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846206.610903:0:3643:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 499 00000100:00080000:3.0:1788846206.610911:0:3643:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff90e450e6a800 using connection 192.168.203.120@tcp/0@lo 00000020:00000080:3.0:1788846206.610926:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342701800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788846206.610969:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e446115000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788846206.610990:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342706800 for lustre-MDT0001 00000020:00000080:3.0:1788846206.610995:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e344566000 for lustre-MDT0001 00000100:00100000:3.0:1788846206.611087:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745cca80 x1875740702493824/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846206.611121:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6db0807f-6150-4b75-b37b-0ed71f62ed94:3639:1875740702493824:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788846206.611162:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875740702493824 offset 0 length 520: 4 00000100:00080000:0.0:1788846206.611207:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788846206.611210:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702493568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846206.611226:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702493440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788846206.611277:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788846206.611293:0:20861:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788846206.611355:0:20861:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:2.0:1788846206.611360:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846206.611367:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1788846206.611367:0:20861:0:(import.c:65:import_set_state_nolock()) ffff90e44314c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788846206.611381:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788846206.611384:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788846206.611386:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00010000:00010000:2.0:1788846206.611387:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788846206.611395:0:20861:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1788846206.611398:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846206.611400:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846206.611402:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846206.611428:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:0:1875740702493696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846206.611507:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702494080:0@lo:9:umount.0 00000100:00100000:3.0:1788846206.611577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788846206.611590:0:20861:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788846206.611601:0:20861:0:(import.c:65:import_set_state_nolock()) ffff90e446110000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788846206.611620:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702494208:0@lo:9:umount.0 00000100:00100000:3.0:1788846206.611641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788846206.611641:0:20861:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff90e3426599b8) has no exports 00000100:00100000:0.0:1788846206.611676:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702494080 00000100:00100000:0.0:1788846206.611683:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702494080 00000100:00100000:0.0:1788846206.611724:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702494208 00000100:00100000:0.0:1788846206.611727:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702494208 00000100:00100000:0.0:1788846206.611755:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788846206.611763:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875740702494080:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788846206.611797:0:18595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272d1a 00000100:00080000:0.0:1788846206.611805:0:18595:0:(import.c:65:import_set_state_nolock()) ffff90e468fb2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788846206.611838:0:18595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788846206.611847:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846206.611853:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:0:1875740702493952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846206.611870:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788846206.611878:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1875740702494208:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788846206.611889:0:19458:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272db4 00000100:00080000:2.0:1788846206.611895:0:19458:0:(import.c:65:import_set_state_nolock()) ffff90e342703000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788846206.611920:0:19458:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788846206.611956:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3639:x1875740702494080:12345-0@lo:9:umount.0 Request processed in 193us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846206.611973:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788846206.611999:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3639:x1875740702494208:12345-0@lo:9:umount.0 Request processed in 123us (357us total) trans 0 rc 0/0 00000100:00080000:0.0:1788846206.612000:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846206.612006:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788846206.612011:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846206.612142:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788846206.612172:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e446110000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788846206.612316:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90e450e6a800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1788846206.612331:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702493312:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1788846206.613023:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788846206.613031:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846206.613036:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702494208:0@lo:9:umount.0 00000100:00080000:2.0:1788846206.613057:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e44314c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000001:00100000:0.0:1788846206.613598:0:18592:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788846206.613602:0:18592:0:(genops.c:885:class_export_put()) final put ffff90e468fb0800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788846206.613615:0:18592:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788846206.613617:0:18592:0:(genops.c:885:class_export_put()) final put ffff90e342707000/lustre-MDT0000-mdtlov_UUID 00000004:00080000:2.0:1788846206.613746:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000001:00100000:3.0:1788846206.614145:0:19412:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788846206.614149:0:19412:0:(genops.c:885:class_export_put()) final put ffff90e342701000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788846206.614157:0:19412:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788846206.614158:0:19412:0:(genops.c:885:class_export_put()) final put ffff90e343638800/lustre-MDT0000-mdtlov_UUID 00000004:00080000:2.0:1788846206.614185:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846206.614313:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702494080:0@lo:9:umount.0 00000020:00000080:2.0:1788846206.614344:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e468fb0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788846206.614633:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342707000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788846206.614655:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342701000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788846206.614664:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e343638800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788846206.614674:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e468fb2800 for lustre-OST0000 00000020:00000080:2.0:1788846206.614677:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342705000 for lustre-OST0000 00000020:00000080:2.0:1788846206.614679:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342703000 for lustre-OST0001 00000020:00000080:2.0:1788846206.614681:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e34363b000 for lustre-OST0001 00000020:00080000:3.0:1788846206.619931:0:20861:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff90e3426599b8) has no exports 00010000:00010000:2.0:1788846206.651814:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788846206.684809:0:20861:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e341ea7660 - data ffff90e478963870/ffff90e342443000 00000020:01000000:2.0:1788846206.684950:0:20861:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e47d07ff00 - data ffff90e47897f510/ffff90e47d6d0800 00000001:00000004:1.0:1788846206.694988:0:20861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788846206.735431:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788846206.735439:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788846206.735445:0:20861:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788846206.743224:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788846206.743231:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788846206.743254:0:20861:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846206.743257:0:20861:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788846206.744423:0:17830:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788846206.744430:0:17830:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1788846206.744442:0:17830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788846206.745318:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788846206.745325:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788846206.745346:0:20861:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846206.745348:0:20861:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788846206.747421:0:17832:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788846206.747429:0:17832:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788846206.747460:0:17832:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788846206.750303:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272b84 00000020:00000080:2.0:1788846206.750314:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e446113000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788846206.750453:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e446113000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788846206.751166:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272b99 00000020:00000080:3.0:1788846206.751173:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e451417000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788846206.751181:0:20861:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788846206.751187:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846206.751195:0:20861:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788846206.751200:0:20861:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90e34265cd28) has no exports 00000004:01000000:3.0:1788846206.753162:0:20861:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788846206.753178:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272bed 00000020:00000080:3.0:1788846206.753187:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e34366f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788846206.753196:0:20861:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788846206.753204:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846206.753212:0:20861:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788846206.753216:0:20861:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff90e47b68b370) has no exports 00000020:00000080:3.0:1788846206.753223:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272be6 00000020:00000080:3.0:1788846206.753226:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e343669800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788846206.753693:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e451417000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1788846206.753705:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34366f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788846206.753712:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e343669800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788846206.754435:0:20861:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788846206.754441:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788846206.754445:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788846206.754451:0:20861:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788846206.754453:0:20861:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846206.754491:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846206.754499:0:20861:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788846206.754506:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272bd8 00000020:00000080:3.0:1788846206.754512:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e34366b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788846206.754517:0:20861:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788846206.754539:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846206.754543:0:20861:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788846206.754546:0:20861:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff90e4752eb370) has no exports 00000020:00000080:3.0:1788846206.754551:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272bca 00000020:00000080:3.0:1788846206.754555:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e4464c2000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788846206.754649:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e446110000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788846206.754667:0:38:0:(genops.c:885:class_export_put()) final put ffff90e34366e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788846206.754669:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34366e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788846206.754681:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788846206.754806:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34366b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788846206.754813:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4464c2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788846206.754982:0:20861:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788846206.754986:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788846206.754988:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788846206.754991:0:20861:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788846206.754993:0:20861:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846206.755021:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846206.755026:0:20861:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788846206.755037:0:20861:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788846206.755050:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272bbc 00000020:00000080:3.0:1788846206.755054:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e446111000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788846206.755058:0:20861:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788846206.755062:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846206.755065:0:20861:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788846206.755068:0:20861:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90e46d5199b8) has no exports 00000020:00000080:3.0:1788846206.755072:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272bb5 00000020:00000080:3.0:1788846206.755074:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e446112000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788846206.755650:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e44314c000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788846206.755659:0:38:0:(genops.c:885:class_export_put()) final put ffff90e458352800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788846206.755661:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e458352800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788846206.755666:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788846206.755727:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e446111000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788846206.755733:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e446112000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788846206.756662:0:20861:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788846206.756668:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788846206.756672:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788846206.756678:0:20861:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788846206.756729:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846206.756738:0:20861:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788846206.756786:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846206.756790:0:20861:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788846206.756793:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e47f490000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788846206.756797:0:20861:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47f490000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788846206.756802:0:20861:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788846206.756936:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272ba0 00000020:00000080:2.0:1788846206.756942:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e451410000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788846206.756947:0:20861:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788846206.756950:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846206.756954:0:20861:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788846206.756957:0:20861:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90e474c7b370) has no exports 00000020:00000080:2.0:1788846206.756998:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846206.757002:0:20861:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788846206.757006:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272ba7 00000020:00000080:2.0:1788846206.757011:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e451413000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788846206.757017:0:20861:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e475188800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788846206.757021:0:20861:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e475188800 2 00000020:01000004:2.0:1788846206.757024:0:20861:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90e475188800 from lustre-MDT0001 00000020:00000080:2.0:1788846206.757050:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846206.757054:0:20861:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788846206.757057:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e446113800/lustre-MDT0001_UUID 00000020:00000080:2.0:1788846206.757059:0:20861:0:(genops.c:844:class_export_destroy()) destroying export ffff90e446113800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788846206.757066:0:20861:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788846206.757094:0:20861:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788846206.757098:0:20861:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788846206.757100:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846206.757104:0:20861:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788846206.757109:0:20861:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff90e448700800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788846206.757114:0:20861:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff90e474c799b8) has exports, disconnecting them 00000020:00080000:2.0:1788846206.757118:0:20861:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff90e448700800), last request at 1788846128 00000020:00000080:2.0:1788846206.757122:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272c25 00000020:00080000:2.0:1788846206.757134:0:20861:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e448700800): rc 0 00000020:00000080:2.0:1788846206.757138:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e448700800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788846206.757810:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e343be0000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788846206.757820:0:38:0:(genops.c:885:class_export_put()) final put ffff90e4464c7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788846206.757822:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4464c7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788846206.757832:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788846206.757927:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e451410000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788846206.757931:0:38:0:(genops.c:885:class_export_put()) final put ffff90e47f496800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788846206.757933:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47f496800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788846206.757936:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788846206.758034:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e451413000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788846206.758038:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e448700800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788846206.764705:0:20861:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788846206.764714:0:20861:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788846206.764719:0:20861:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788846206.764727:0:20861:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788846206.764779:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47f495800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788846206.764981:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788846206.764991:0:20861:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788846206.764998:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e448702800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788846206.765003:0:20861:0:(genops.c:844:class_export_destroy()) destroying export ffff90e448702800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788846206.765009:0:20861:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788846206.765082:0:20861:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e475188800 1 00000020:00000080:1.0:1788846206.765090:0:20861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272b4c 00000020:00000080:1.0:1788846206.765097:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e458350800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788846206.765105:0:20861:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788846206.765112:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e458350800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788846206.765121:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846206.765127:0:20861:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788846206.765131:0:20861:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff90e46d518000) has no exports 00000100:00080000:3.0:1788846206.782204:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788846206.782225:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788846206.782230:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e34363a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846206.782238:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 585 00000100:00080000:3.0:1788846206.782245:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788846206.782252:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90e34363a000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846206.782290:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745cc000 x1875740702494336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788846206.782353:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788846206.782357:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788846206.782359:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e46e21a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846206.782364:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 585 00000100:00080000:3.0:1788846206.782366:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788846206.782371:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90e46e21a800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846206.782385:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745cdf80 x1875740702494592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846206.782392:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702494336:0@lo:38:kworker.0 00000100:00100000:3.0:1788846206.782420:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702494720:0@lo:400:kworker.0 00000100:00100000:1.0:1788846206.782471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846206.782552:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702494592:0@lo:38:kworker.0 00000100:00100000:1.0:1788846206.782578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846206.782623:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702494336 00000100:00100000:1.0:1788846206.782629:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702494336 00000100:00100000:1.0:1788846206.782658:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702494592 00000100:00100000:1.0:1788846206.782661:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702494592 00000100:00100000:1.0:1788846206.782679:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788846206.782686:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702494336:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788846206.782703:0:17088:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788846206.785230:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788846206.785241:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702494592:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788846206.785261:0:17090:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788846206.785357:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702494592:12345-0@lo:38:kworker.0 Request processed in 115us (2777us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788846206.785364:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788846206.786624:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e46e21a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846206.786633:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788846206.786637:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702494592:0@lo:38:kworker.0 00000100:00100000:2.0:1788846206.786873:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702494464:0@lo:400:kworker.0 00000100:00100000:2.0:1788846206.786925:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846206.786969:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702494464 00000100:00100000:2.0:1788846206.786975:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702494464 00000100:00100000:2.0:1788846206.787001:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788846206.787006:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875740702494464:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788846206.787013:0:17090:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788846206.787060:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875740702494464:12345-0@lo:400:kworker.0 Request processed in 52us (133us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788846206.787067:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788846206.787093:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788846206.787097:0:3642:0:(import.c:65:import_set_state_nolock()) ffff90e44716a800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788846206.787100:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788846206.789846:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788846206.802721:0:3642:0:(import.c:65:import_set_state_nolock()) ffff90e44716a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846206.802817:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 528 00000100:00080000:2.0:1788846206.802828:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90e44716a800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846206.802857:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702494720 00000100:00100000:2.0:1788846206.802867:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702494720 00000100:00100000:2.0:1788846206.802918:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788846206.802926:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875740702494720:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788846206.802935:0:17090:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788846206.803021:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875740702494720:12345-0@lo:400:kworker.0 Request processed in 93us (13179us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788846206.803027:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1788846206.806983:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788846206.806991:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e34366d000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788846206.806995:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788846206.807001:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e34366d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846206.807005:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 543 00000100:00080000:3.0:1788846206.807013:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90e34366d000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846206.807048:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745ce300 x1875740702494848/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846206.807078:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702494720:0@lo:400:kworker.0 00000100:00100000:3.0:1788846206.807114:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702494848:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788846206.807305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846206.807436:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702494848 00000100:00100000:3.0:1788846206.807444:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702494848 00000100:00100000:3.0:1788846206.807480:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788846206.807487:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702494848:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788846206.807505:0:17089:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788846206.808359:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702494848:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 868us (1053us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788846206.808368:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788846206.808404:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e34366d000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846206.808410:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788846206.808413:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702494848:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788846206.810601:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e448f86d80 x1875740702494976/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846206.810640:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702494464:0@lo:400:kworker.0 00000100:00100000:1.0:1788846206.812310:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702494336:12345-0@lo:38:kworker.0 Request processed in 29616us (29833us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788846206.812330:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788846206.813713:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875740702494976:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788846206.813987:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788846206.814067:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e34363a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846206.814072:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788846206.814076:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702494336:0@lo:38:kworker.0 00000100:00100000:1.0:1788846206.818397:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702494976 00000100:00100000:1.0:1788846206.818412:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702494976 00000100:00100000:1.0:1788846206.818478:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788846206.818487:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1875740702494976:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1788846206.818506:0:18618:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788846206.818600:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1875740702494976:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 111us (4612us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788846206.818608:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788846206.818680:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e44716a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846206.818687:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788846206.818691:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875740702494976:0@lo:38:ptlrpcd_00_02.0 00000020:00000080:1.0:1788846206.866502:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788846206.866515:0:20861:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788846206.866811:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e3438b1000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788846206.866815:0:20861:0:(genops.c:844:class_export_destroy()) destroying export ffff90e3438b1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788846206.866827:0:20861:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788846206.867009:0:20861:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90e475189000 00000020:01000000:1.0:1788846206.867027:0:20861:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788846206.867031:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846206.867036:0:20861:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788846206.867040:0:20861:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90e34387b370) has no exports 00000100:00100000:3.0:1788846206.867270:0:17090:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90e47d091400:17090] 2 exiting: rc = 0 00000100:00100000:1.0:1788846206.867627:0:17089:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff90e341e20200:17089] 1 exiting: rc = 0 00000100:00100000:2.0:1788846206.867929:0:18618:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff90e3410bda00:18618] 3 exiting: rc = 0 00000100:00100000:0.0:1788846206.868103:0:17088:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff90e47d091a00:17088] 0 exiting: rc = 1 00000100:00100000:0.0:1788846206.868167:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868174:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868180:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868185:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868189:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868194:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868200:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868205:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868210:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868215:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868221:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868238:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868243:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868248:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868254:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868259:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868265:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868270:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868275:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868280:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868285:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868290:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868296:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868301:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868306:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868312:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868317:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868323:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868329:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868335:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868340:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868346:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868357:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868362:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868367:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868372:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868377:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868382:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868391:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868397:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868402:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868452:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868457:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868463:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868468:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868474:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868488:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868494:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868499:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868504:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868510:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868516:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868675:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868681:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868686:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868691:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868696:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868702:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868707:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868713:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868718:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868724:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868731:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.868736:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846206.871458:0:17091:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90e4502e6800:17091] 0 exiting: rc = 1 00000100:00100000:0.0:1788846206.871738:0:17092:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90e4502e6c00:17092] 1 exiting: rc = 0 00000100:00100000:1.0:1788846206.871839:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871847:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871852:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871857:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871862:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871867:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871880:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871886:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871891:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871896:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871900:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871905:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871910:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871914:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871920:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871925:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871931:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871936:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871940:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871944:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871947:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871951:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871954:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871957:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871960:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871980:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871984:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871989:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.871995:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872000:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872005:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872010:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872015:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872019:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872024:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872030:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872035:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872040:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872045:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872049:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872055:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872060:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872066:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872071:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872076:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872080:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872085:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872091:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872096:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872100:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872106:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872111:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872116:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872120:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872126:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872131:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872135:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872141:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872146:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872151:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872164:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872169:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872174:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872178:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.872631:0:17829:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff90e475233400:17829] 2 exiting: rc = 0 00000100:00100000:0.0:1788846206.872825:0:17094:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff90e4518f0600:17094] 1 exiting: rc = 0 00000100:00100000:3.0:1788846206.873010:0:17093:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff90e4518f1200:17093] 0 exiting: rc = 1 00000100:00100000:1.0:1788846206.873093:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873099:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873105:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873111:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873117:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873123:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873128:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873135:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873141:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873148:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873153:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873165:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873171:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873177:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873197:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873204:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873209:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873215:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873221:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873228:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873233:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873239:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873244:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873250:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873256:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873261:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873282:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873289:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873295:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873300:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873318:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873323:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873330:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873336:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873342:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873347:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873353:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873358:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873378:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873385:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873391:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873397:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873403:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873409:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873414:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873419:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873424:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873430:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873436:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873442:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873461:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873468:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873474:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873480:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873867:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873949:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873956:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873962:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873968:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873973:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873979:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873985:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873991:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.873998:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.882292:0:17095:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90e461dbb000:17095] 0 exiting: rc = 1 00000100:00100000:1.0:1788846206.882503:0:17096:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90e450157200:17096] 1 exiting: rc = 0 00000100:00100000:0.0:1788846206.882750:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882758:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882772:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882777:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882782:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882788:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882793:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882798:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882803:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882808:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882813:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882818:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882822:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882827:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882831:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882845:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882850:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882855:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882859:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882864:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882868:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882873:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882878:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882883:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882887:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882893:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882898:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882903:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882908:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882912:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882917:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882922:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882927:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882932:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882938:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882943:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882948:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882953:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882959:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882963:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.882968:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883084:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883089:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883095:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883099:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883104:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883109:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883115:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883120:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883125:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883143:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883149:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883153:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883158:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883162:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883167:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883172:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883176:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883181:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883185:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883191:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883195:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883200:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.883205:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846206.884176:0:17098:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90e453439000:17098] 1 exiting: rc = 0 00000100:00100000:1.0:1788846206.884290:0:17097:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90e47519a800:17097] 0 exiting: rc = 1 00000100:00100000:1.0:1788846206.884344:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884351:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884357:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884363:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884368:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884375:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884379:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884385:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884390:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884395:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884400:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884405:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884410:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884415:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884420:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884425:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884430:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884436:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884441:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884446:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884451:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884456:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884461:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884466:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884471:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884475:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884481:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884486:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884491:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884496:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884501:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884507:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884512:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884826:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884831:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884836:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884841:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884846:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884850:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884855:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884859:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884864:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884869:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884874:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884879:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884889:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884894:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884898:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884904:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884909:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884914:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884918:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884924:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884929:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884934:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884939:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884945:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884950:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884955:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884960:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884965:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884979:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884984:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.884990:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846206.888056:0:17100:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff90e343659200:17100] 1 exiting: rc = 0 00000100:00100000:3.0:1788846206.888264:0:17099:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff90e342a44400:17099] 0 exiting: rc = 1 00000100:00100000:1.0:1788846206.888301:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888308:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888314:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888322:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888341:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888346:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888351:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888356:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888362:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888367:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888372:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888377:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888382:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888387:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888392:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888397:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888402:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888408:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888413:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888418:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888423:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888427:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888432:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888437:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888442:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888446:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888451:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888455:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888464:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888469:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888474:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888479:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888484:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888488:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888496:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888501:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888505:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888510:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888516:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888559:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888564:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888569:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888574:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888579:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888584:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888588:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888592:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888598:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888603:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888608:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888613:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888623:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888628:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888632:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888637:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888642:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888646:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888651:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888655:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888659:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888664:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888668:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888673:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.888678:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846206.892211:0:17101:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff90e46e333000:17101] 0 exiting: rc = 1 00000100:00100000:1.0:1788846206.895517:0:17102:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff90e446475000:17102] 1 exiting: rc = 0 00000100:00100000:2.0:1788846206.896197:0:17103:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff90e47506d600:17103] 2 exiting: rc = 0 00000100:00100000:1.0:1788846206.897835:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897844:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897849:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897864:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897886:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897892:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897898:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897904:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897912:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897928:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897933:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897939:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897949:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897954:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897960:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897966:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897971:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897977:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897982:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897988:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.897994:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898000:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898005:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898011:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898016:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898022:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898028:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898034:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898176:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898185:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898190:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898196:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898202:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898207:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898213:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898220:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898297:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898305:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898310:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898381:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898387:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898393:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898398:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898403:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898415:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898421:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898426:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898431:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898437:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898443:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898448:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898453:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898473:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898479:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898485:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898491:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898497:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898502:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898507:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898513:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898536:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898543:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898549:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846206.898561:0:20861:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788846206.904924:0:20861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846206.904938:0:20861:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788846206.904957:0:20861:0:(genops.c:885:class_export_put()) final put ffff90e469b17000/MDS_uuid 00000020:00000080:2.0:1788846206.904965:0:20861:0:(genops.c:844:class_export_destroy()) destroying export ffff90e469b17000/MDS_uuid for MDS 00000020:01000000:2.0:1788846206.904971:0:20861:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788846206.905116:0:20861:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788846207.674690:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846208.699429:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846209.722878:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788846210.261087:0:21062:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788846210.274619:0:21062:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788846210.274673:0:21062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.274688:0:21062:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.274706:0:21062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.274722:0:21062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.274750:0:21062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788846210.274756:0:21062:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788846210.274781:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846210.274786:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.274806:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846210.274810:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.274818:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846210.274824:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846210.274829:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788846210.274831:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788846210.274834:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788846210.274847:0:17076:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e450e6a800 00010000:00010000:0.0:1788846210.274850:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.274856:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.274866:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846210.274867:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846210.274869:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788846210.274883:0:21062:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846210.274887:0:21062:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788846210.274892:0:21062:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788846210.274898:0:21062:0:(import.c:65:import_set_state_nolock()) ffff90e34363a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788846210.274903:0:21062:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846210.274911:0:21062:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788846210.274914:0:21062:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788846210.275907:0:21062:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788846210.275912:0:21062:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788846210.275918:0:21062:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788846210.275921:0:21062:0:(import.c:65:import_set_state_nolock()) ffff90e44716a800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788846210.275925:0:21062:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788846210.275927:0:21062:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788846210.275929:0:21062:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788846210.277888:0:21062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.277908:0:21062:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.277915:0:21062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.277921:0:21062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.277990:0:21062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846210.277998:0:21062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.278004:0:21062:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.278009:0:21062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846210.278033:0:21062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846210.281272:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846210.281288:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846210.281301:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846210.281305:0:17844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846210.281317:0:17844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846210.281324:0:17844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846210.281331:0:17844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788846210.281334:0:17844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788846210.281350:0:17844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e450e6a800 00010000:00010000:2.0:1788846210.281353:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846210.281361:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846210.281378:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846210.281383:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846210.281406:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846210.281410:0:17844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846210.281417:0:17844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846210.281423:0:17844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846210.281429:0:17844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788846210.281432:0:17844:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788846210.281437:0:17844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e450e6a800 00010000:00010000:2.0:1788846210.281440:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846210.281448:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846210.281450:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846210.281452:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846210.282335:0:21062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788846210.282346:0:21062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846210.282364:0:21062:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788846210.282370:0:21062:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788846210.282372:0:21062:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788846210.282408:0:21062:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788846210.282413:0:21062:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788846210.282419:0:21062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846210.282424:0:21062:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788846210.282429:0:21062:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff90e46d51b370) has no exports 00000020:00080000:0.0:1788846210.282451:0:21062:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff90e46d51b370) has no exports 00000020:01000000:0.0:1788846210.288038:0:21062:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e342912180 - data ffff90e47881f6c0/ffff90e4745cb400 00000020:01000000:0.0:1788846210.288220:0:21062:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e34252f240 - data ffff90e449fd86c0/ffff90e468fa7800 00010000:00010000:2.0:1788846210.288993:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788846210.304287:0:21062:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788846210.328959:0:21062:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272caa 00000020:00000080:2.0:1788846210.328976:0:21062:0:(genops.c:885:class_export_put()) final put ffff90e458353800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788846210.328989:0:21062:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e47f491800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788846210.328992:0:21062:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e47f491800 2 00000020:01000004:2.0:1788846210.328995:0:21062:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90e47f491800 from lustre-OST0000 00000020:00000080:2.0:1788846210.329017:0:21062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846210.329026:0:21062:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788846210.329029:0:21062:0:(genops.c:885:class_export_put()) final put ffff90e343669000/lustre-OST0000_UUID 00000020:00000080:2.0:1788846210.329032:0:21062:0:(genops.c:844:class_export_destroy()) destroying export ffff90e343669000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788846210.329042:0:21062:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788846210.329097:0:21062:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788846210.329110:0:21062:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788846210.329113:0:21062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846210.329118:0:21062:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788846210.329124:0:21062:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90e44716a000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788846210.329130:0:21062:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff90e46d51cd28) has exports, disconnecting them 00000020:00080000:2.0:1788846210.329138:0:21062:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90e44716a000), last request at 1788846144 00000020:00000080:2.0:1788846210.329141:0:21062:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272cd4 00000020:00080000:2.0:1788846210.329154:0:21062:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e44716a000): rc 0 00000020:00000080:2.0:1788846210.329159:0:21062:0:(genops.c:885:class_export_put()) final put ffff90e44716a000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788846210.330260:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e458353800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788846210.330273:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e44716a000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788846210.354649:0:21062:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788846210.354656:0:21062:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788846210.354660:0:21062:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788846210.354667:0:21062:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846210.354838:0:21062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846210.354848:0:21062:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788846210.354856:0:21062:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788846210.354860:0:21062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846210.354864:0:21062:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788846210.354870:0:21062:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff90e34363d800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788846210.354876:0:21062:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff90e449bdcd28) has exports, disconnecting them 00000020:00080000:3.0:1788846210.354881:0:21062:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff90e34363d800), last request at 1788846144 00000020:00000080:3.0:1788846210.354885:0:21062:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272ce9 00000020:00080000:3.0:1788846210.354900:0:21062:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e34363d800): rc 0 00000020:00000080:3.0:1788846210.354906:0:21062:0:(genops.c:885:class_export_put()) final put ffff90e34363d800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788846210.355027:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e34363a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788846210.355035:0:38:0:(genops.c:885:class_export_put()) final put ffff90e34363a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788846210.355037:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34363a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788846210.355048:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788846210.355111:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34363d800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788846210.384577:0:21062:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788846210.384586:0:21062:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788846210.384591:0:21062:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788846210.384597:0:21062:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788846210.384643:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e44716a800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788846210.384854:0:21062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846210.384864:0:21062:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788846210.384870:0:21062:0:(genops.c:885:class_export_put()) final put ffff90e34363c000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788846210.384874:0:21062:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34363c000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788846210.384886:0:21062:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788846210.384961:0:21062:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e47f491800 1 00000020:00000080:2.0:1788846210.384967:0:21062:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272c87 00000020:00000080:2.0:1788846210.384974:0:21062:0:(genops.c:885:class_export_put()) final put ffff90e44716d000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788846210.385164:0:21062:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788846210.385169:0:21062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846210.385175:0:21062:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788846210.385179:0:21062:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff90e341e54d28) has no exports 00000020:00000080:1.0:1788846210.385290:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e44716d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788846210.423538:0:21062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846210.423551:0:21062:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788846210.423557:0:21062:0:(genops.c:885:class_export_put()) final put ffff90e4491b6000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788846210.423561:0:21062:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4491b6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788846210.423583:0:21062:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788846210.423686:0:21062:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90e4491b7000 00000020:02000400:3.0:1788846210.425044:0:21062:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788846210.750398:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846211.769845:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788846211.898834:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6db0807f-6150-4b75-b37b-0ed71f62ed94->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788846211.898844:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6db0807f-6150-4b75-b37b-0ed71f62ed94->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846211.898856:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788846211.898860:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788846211.898865:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e46e21a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846211.898874:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 590 00000100:00080000:1.0:1788846211.898881:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788846211.898889:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90e46e21a800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846211.898932:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474543100 x1875740702495104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846211.898953:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788846211.898957:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788846211.898958:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e34366d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846211.898961:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 590 00000100:00080000:1.0:1788846211.898964:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788846211.898966:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90e34366d000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846211.898975:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474540a80 x1875740702495232/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846211.899585:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702495104:0@lo:38:kworker.0 00000400:00000100:0.0:1788846211.899651:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740702495104 offset 0 length 520: 4 00000100:00100000:0.0:1788846211.900451:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702495232:0@lo:38:kworker.0 00000400:00000100:0.0:1788846211.900491:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740702495232 offset 0 length 520: 4 00010000:00010000:3.0:1788846212.793697:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846213.817878:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788846214.118872:0:21263:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788846214.142254:0:21263:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788846214.142345:0:21263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846214.142360:0:21263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846214.142369:0:21263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846214.142376:0:21263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846214.142400:0:21263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788846214.142406:0:21263:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788846214.142431:0:21263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788846214.142442:0:21263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e474543100 x1875740702495104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846231 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846214.142464:0:21263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788846214.142471:0:21263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788846214.142492:0:21263:0:(import.c:65:import_set_state_nolock()) ffff90e46e21a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788846214.142558:0:21263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788846214.142563:0:21263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e474543100 x1875740702495104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846231 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846214.142569:0:21263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788846214.142572:0:21263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00010000:00010000:2.0:1788846214.142769:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846214.142783:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846214.142791:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42dc00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846214.142795:0:17844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846214.142803:0:17844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846214.142811:0:17844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846214.142816:0:17844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788846214.142819:0:17844:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788846214.142822:0:17844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788846214.142834:0:17844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e450e6a800 00010000:00010000:2.0:1788846214.142840:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846214.142840:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702495104:0@lo:38:kworker.0 00010000:00010000:2.0:1788846214.142852:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846214.142864:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846214.142866:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846214.142867:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788846214.144285:0:21263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788846214.144300:0:21263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e474540a80 x1875740702495232/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846226 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846214.144324:0:21263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788846214.144329:0:21263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788846214.144345:0:21263:0:(import.c:65:import_set_state_nolock()) ffff90e34366d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788846214.144350:0:21263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788846214.144354:0:21263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e474540a80 x1875740702495232/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846226 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846214.144362:0:21263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788846214.144365:0:21263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1788846214.144490:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702495232:0@lo:38:kworker.0 00010000:00010000:2.0:1788846214.146018:0:21263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846214.146036:0:21263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846214.146044:0:21263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846214.146050:0:21263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846214.146068:0:21263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846214.146076:0:21263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846214.146083:0:21263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846214.146089:0:21263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846214.146095:0:21263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846214.146131:0:21263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788846214.146137:0:21263:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788846214.146162:0:21263:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788846214.146166:0:21263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788846214.146171:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788846214.146221:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788846214.146229:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846214.146251:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064e00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846214.146255:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846214.146270:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846214.146278:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788846214.146282:0:21263:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:01000000:1.0:1788846214.146284:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788846214.146288:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00000020:00080000:2.0:1788846214.146289:0:21263:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff90e449bdb370) has no exports 10000000:01000000:1.0:1788846214.146291:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788846214.146305:0:17076:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e450e6a800 00010000:00010000:1.0:1788846214.146310:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846214.146317:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788846214.146323:0:21263:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff90e449bdb370) has no exports 00010000:00010000:1.0:1788846214.146337:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846214.146342:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846214.146348:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846214.146350:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846214.146357:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846214.146363:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846214.146378:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788846214.146381:0:17076:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788846214.146382:0:17076:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788846214.146388:0:17076:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e450e6a800 00010000:00010000:1.0:1788846214.146391:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846214.146691:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846214.146708:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846214.146710:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846214.146722:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846214.148162:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788846214.152906:0:21263:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e341ea73c0 - data ffff90e451059af8/ffff90e342440800 00000020:01000000:2.0:1788846214.153057:0:21263:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e3429126c0 - data ffff90e342064ca8/ffff90e3439d5c00 00100000:10000000:2.0:1788846214.169404:0:21263:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788846214.183783:0:21263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272d44 00000020:00000080:1.0:1788846214.183795:0:21263:0:(genops.c:885:class_export_put()) final put ffff90e44716f000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788846214.183813:0:21263:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e344565000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788846214.183817:0:21263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e344565000 2 00000020:01000004:1.0:1788846214.183819:0:21263:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90e344565000 from lustre-OST0001 00000020:00000080:1.0:1788846214.183846:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788846214.183857:0:21263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788846214.183859:0:21263:0:(genops.c:885:class_export_put()) final put ffff90e34363f000/lustre-OST0001_UUID 00000020:00000080:1.0:1788846214.183862:0:21263:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34363f000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788846214.183873:0:21263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1788846214.183904:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e44716f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1788846214.183975:0:21263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6db0807f-6150-4b75-b37b-0ed71f62ed94->MGS 00010000:00010000:1.0:1788846214.183991:0:21263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138272b53 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272b5a expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846214.184004:0:21263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138272b53 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272b5a expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846214.184024:0:21263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788846214.184027:0:21263:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788846214.184030:0:21263:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788846214.184045:0:21263:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e450e6a800 00010000:00010000:1.0:1788846214.184049:0:21263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138272b53 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272b5a expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846214.184064:0:21263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846214.184070:0:21263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846214.184074:0:21263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788846214.184076:0:21263:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788846214.184078:0:21263:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788846214.184085:0:21263:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e450e6a800 00010000:00010000:1.0:1788846214.184087:0:21263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788846214.184102:0:21263:0:(import.c:65:import_set_state_nolock()) ffff90e450e6a800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788846214.184105:0:21263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788846214.184108:0:21263:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788846214.184109:0:21263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788846214.184113:0:21263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788846214.184124:0:21263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e4745cca80 x1875740702493824/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788846216 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788846214.184146:0:21263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788846214.184149:0:21263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1788846214.184227:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6db0807f-6150-4b75-b37b-0ed71f62ed94:3639:1875740702493824:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:1.0:1788846214.184364:0:21263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788846214.184381:0:21263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272a2d 00000020:00000080:1.0:1788846214.184386:0:21263:0:(genops.c:885:class_export_put()) final put ffff90e469b15000/6db0807f-6150-4b75-b37b-0ed71f62ed94 00000020:01000000:1.0:1788846214.184399:0:21263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.120@tcp (flags='') 00000020:00000080:1.0:1788846214.184403:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846214.184409:0:21263:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788846214.184412:0:21263:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff90e34265b370) has no exports 00000020:00000080:0.0:1788846214.184463:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e469b15000/6db0807f-6150-4b75-b37b-0ed71f62ed94 for MGC192.168.203.120@tcp 10000000:01000000:3.0:1788846214.184548:0:17086:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788846214.186868:0:21263:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.120@tcp: client import never connected 00000100:00080000:1.0:1788846214.186880:0:21263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788846214.186884:0:21263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788846214.186889:0:21263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788846214.186891:0:21263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788846214.186940:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788846214.186947:0:21263:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.120@tcp (uuid 6db0807f-6150-4b75-b37b-0ed71f62ed94) 00000020:01000000:1.0:1788846214.186953:0:21263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788846214.186957:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846214.186961:0:21263:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788846214.186968:0:21263:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90e447169000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788846214.186974:0:21263:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff90e474c78000) has exports, disconnecting them 00000020:00080000:1.0:1788846214.186978:0:21263:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90e447169000), last request at 1788846159 00000020:00000080:1.0:1788846214.186982:0:21263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272d6e 00000020:00080000:1.0:1788846214.186993:0:21263:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e447169000): rc 0 00000020:00000080:1.0:1788846214.186996:0:21263:0:(genops.c:885:class_export_put()) final put ffff90e447169000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788846214.187421:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e450e6a800 for MGC192.168.203.120@tcp 00000020:00000080:3.0:1788846214.187440:0:16008:0:(genops.c:885:class_export_put()) final put ffff90e450e68800/6db0807f-6150-4b75-b37b-0ed71f62ed94 00000020:00000080:3.0:1788846214.187443:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e450e68800/6db0807f-6150-4b75-b37b-0ed71f62ed94 for MGC192.168.203.120@tcp 00000020:01000000:3.0:1788846214.187453:0:16008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.120@tcp (6db0807f-6150-4b75-b37b-0ed71f62ed94) 00000020:00000080:3.0:1788846214.188028:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e447169000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788846214.197627:0:21263:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788846214.197636:0:21263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846214.197651:0:21263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788846214.197658:0:21263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788846214.197885:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846214.197894:0:21263:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788846214.197901:0:21263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788846214.197906:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846214.197910:0:21263:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788846214.197917:0:21263:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff90e44716c000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788846214.197924:0:21263:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff90e449bd99b8) has exports, disconnecting them 00000020:00080000:0.0:1788846214.197928:0:21263:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff90e44716c000), last request at 1788846159 00000020:00000080:0.0:1788846214.197933:0:21263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272d83 00000020:00080000:0.0:1788846214.197949:0:21263:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e44716c000): rc 0 00000020:00000080:0.0:1788846214.197954:0:21263:0:(genops.c:885:class_export_put()) final put ffff90e44716c000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788846214.198040:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e46e21a800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788846214.198059:0:16008:0:(genops.c:885:class_export_put()) final put ffff90e46e21b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788846214.198063:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46e21b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788846214.198087:0:16008:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788846214.198180:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e44716c000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788846214.216781:0:21263:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788846214.216789:0:21263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788846214.216793:0:21263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788846214.216800:0:21263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846214.217158:0:16008:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e34366d000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788846214.217204:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788846214.217290:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788846214.217414:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788846214.217565:0:17071:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90e4607fba00:17071] 0 exiting: rc = 1 00000100:00100000:1.0:1788846214.217565:0:17072:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90e47519d000:17072] 1 exiting: rc = 0 00000100:00100000:0.0:1788846214.217747:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846214.218013:0:17073:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90e47519c000:17073] 0 exiting: rc = 1 00000100:00100000:3.0:1788846214.218678:0:20117:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90e34292a400:20117] 3 exiting: rc = 0 00000100:00100000:3.0:1788846214.218767:0:17075:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90e450c4e400:17075] 2 exiting: rc = 0 00000100:00100000:0.0:1788846214.221661:0:17074:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90e47519d200:17074] 1 exiting: rc = 0 00000100:00100000:1.0:1788846214.222115:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222122:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222128:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222137:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222151:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222157:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222163:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222168:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222173:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222178:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222183:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222187:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222192:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222197:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222202:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222207:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222212:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222216:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222221:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222226:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222232:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222240:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222245:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222250:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222255:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222260:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222266:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222270:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222275:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222280:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222286:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222291:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222296:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222301:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222307:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222312:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222316:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222322:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222327:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222339:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222345:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222351:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222356:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222361:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222366:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222371:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222375:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222380:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222385:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222391:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222396:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222400:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222405:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222409:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222414:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222419:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222424:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222641:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222648:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222653:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222657:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222662:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222740:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.222746:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788846214.223765:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846214.223774:0:21263:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788846214.223784:0:21263:0:(genops.c:885:class_export_put()) final put ffff90e447169800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788846214.223788:0:21263:0:(genops.c:844:class_export_destroy()) destroying export ffff90e447169800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788846214.223796:0:21263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788846214.223842:0:21263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e344565000 1 00000020:00000080:0.0:1788846214.223847:0:21263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138272d28 00000020:00000080:0.0:1788846214.223853:0:21263:0:(genops.c:885:class_export_put()) final put ffff90e344597800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788846214.223867:0:21263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788846214.223871:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846214.223876:0:21263:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788846214.223879:0:21263:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff90e47b688000) has no exports 00000020:00000080:1.0:1788846214.223944:0:16008:0:(genops.c:844:class_export_destroy()) destroying export ffff90e344597800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788846214.251132:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846214.251144:0:21263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788846214.251149:0:21263:0:(genops.c:885:class_export_put()) final put ffff90e344560000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788846214.251153:0:21263:0:(genops.c:844:class_export_destroy()) destroying export ffff90e344560000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788846214.251163:0:21263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788846214.251474:0:21263:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90e344566800 00000020:01000000:3.0:1788846214.251494:0:21263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788846214.251498:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846214.251502:0:21263:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788846214.251514:0:21263:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff90e47b68cd28) has no exports 00000020:00000080:3.0:1788846214.252569:0:21263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846214.252579:0:21263:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788846214.252583:0:21263:0:(genops.c:885:class_export_put()) final put ffff90e44716e800/OSS_uuid 00000020:00000080:3.0:1788846214.252585:0:21263:0:(genops.c:844:class_export_destroy()) destroying export ffff90e44716e800/OSS_uuid for OSS 00000020:01000000:3.0:1788846214.252589:0:21263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788846214.252743:0:19458:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff90e3426caa00:19458] 4 exiting: rc = 0 00000100:00100000:2.0:1788846214.252838:0:18598:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff90e47d68dc00:18598] 2 exiting: rc = 0 00000100:00100000:2.0:1788846214.252894:0:19094:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff90e3410bd000:19094] 3 exiting: rc = 0 00000100:00100000:1.0:1788846214.253047:0:18595:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff90e447047a00:18595] 0 exiting: rc = 1 00000100:00080000:0.0:1788846214.253152:0:17084:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788846214.253251:0:18597:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff90e448f56c00:18597] 1 exiting: rc = 0 00000100:00100000:3.0:1788846214.253361:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253369:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253374:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253380:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253385:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253390:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253394:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253399:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253404:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253409:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253413:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253419:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253424:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253429:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253434:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253441:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253445:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253450:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253455:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253460:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253465:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253469:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253475:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253480:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253484:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253489:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253494:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253499:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253504:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253548:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253554:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253559:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253563:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253569:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253574:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253578:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253583:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253587:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253591:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253596:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253601:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253605:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253610:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253615:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253620:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253625:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253630:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253636:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253641:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253646:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253651:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253656:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253661:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253667:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253673:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253678:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253829:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253835:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253840:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253845:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253850:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253855:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253859:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.253864:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846214.255606:0:19095:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff90e34378ca00:19095] 2 exiting: rc = 0 00000100:00100000:1.0:1788846214.255844:0:18599:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90e447035800:18599] 0 exiting: rc = 1 00000100:00100000:0.0:1788846214.256011:0:18600:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90e447035000:18600] 1 exiting: rc = 0 00000100:00100000:3.0:1788846214.256093:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256101:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256106:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256110:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256116:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256120:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256125:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256132:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256137:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256143:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256148:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256154:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256159:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256164:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256169:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256174:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256179:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256184:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256189:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256194:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256200:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256204:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256209:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256214:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256218:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256222:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256226:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256231:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256236:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256240:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256246:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256251:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256255:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256259:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256272:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256291:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256296:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256301:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256308:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256313:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256318:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256324:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256334:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256345:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256350:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256355:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256360:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256365:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256371:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256376:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256383:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256388:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256393:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256398:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256403:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256408:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256414:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256419:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256423:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256428:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256433:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256438:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256442:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.256447:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846214.258138:0:18602:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90e447034a00:18602] 1 exiting: rc = 0 00000100:00100000:1.0:1788846214.258375:0:18601:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90e47d68e000:18601] 0 exiting: rc = 1 00000100:00100000:2.0:1788846214.258634:0:18603:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90e447039000:18603] 2 exiting: rc = 0 00000100:00100000:3.0:1788846214.258758:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258765:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258770:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258775:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258780:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258785:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258803:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258817:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258823:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258828:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258833:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258838:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258843:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258848:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258856:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258862:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258867:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258872:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258877:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258882:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258886:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258891:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258896:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258902:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258907:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258912:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258917:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258922:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258927:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258931:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258937:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258954:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258960:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258966:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258971:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258975:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258981:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258986:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258992:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.258997:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259003:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259015:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259019:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259024:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259029:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259035:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259040:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259046:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259051:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259056:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259062:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259067:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259073:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259077:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259083:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259103:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259109:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259114:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259119:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259124:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259129:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259134:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259141:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.259146:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.263614:0:18605:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90e46d464000:18605] 1 exiting: rc = 0 00000100:00100000:1.0:1788846214.263958:0:18604:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90e46d464400:18604] 0 exiting: rc = 1 00000100:00100000:3.0:1788846214.264138:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264145:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264150:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264155:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264160:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264165:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264170:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264175:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264179:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264184:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264189:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264203:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264208:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264213:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264218:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264224:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264230:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264235:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264240:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264245:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264250:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264255:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264260:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264265:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264270:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264274:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264279:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264283:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264288:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264293:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264298:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264304:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264309:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264452:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264460:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264465:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264470:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264474:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264480:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264484:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264490:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264495:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264499:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264504:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264509:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264514:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264546:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264576:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264582:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264587:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264591:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264597:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264602:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264607:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264612:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264618:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264623:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264628:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264633:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264638:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264642:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264647:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264651:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.264656:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846214.265408:0:18607:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90e4534e9600:18607] 1 exiting: rc = 0 00000100:00100000:2.0:1788846214.265962:0:18606:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90e447006c00:18606] 0 exiting: rc = 1 00000100:00100000:1.0:1788846214.266090:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266097:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266103:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266109:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266125:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266130:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266137:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266165:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266171:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266176:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266182:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266187:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266192:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266197:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266203:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266208:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266213:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266220:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266225:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266246:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266252:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266258:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266263:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266269:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266274:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266279:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266285:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266290:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266295:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266300:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266306:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266328:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266338:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266347:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266355:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266363:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266369:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266374:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266380:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266394:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266406:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266418:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266425:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266430:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266435:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266440:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266446:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266450:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266455:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266473:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266480:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266486:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266491:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266497:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266503:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266510:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266516:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266576:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266582:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266590:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266595:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266601:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266606:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846214.266619:0:21263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788846214.274878:0:21263:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788846234.350510:0:22027:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788846244.601397:0:22626:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788846244.601404:0:22626:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788846244.601406:0:22626:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788846244.601557:0:22626:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90e474598800 00000020:01000004:1.0:1788846244.601573:0:22626:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788846244.601581:0:22626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788846244.601595:0:22626:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90e474c799b8) 00000020:00000080:1.0:1788846244.601609:0:22626:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788846244.656598:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788846244.656890:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.657908:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.658111:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.658288:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.658476:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.658699:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.659004:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.659208:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.659458:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.659947:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.660179:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.660356:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.660578:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.660757:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.661088:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.661296:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.661502:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.661836:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.662137:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.662311:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.662544:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.662769:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.663076:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.663296:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.663516:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.663973:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.664145:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.664330:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.664549:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.664744:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.665096:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.665293:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788846244.665518:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788846244.666429:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.670089:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788846244.670582:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788846244.670764:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.671306:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.671557:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788846244.671737:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788846244.672043:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.672257:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.672464:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.672768:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788846244.673071:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.673279:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788846244.675003:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.675776:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.676305:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.676737:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.677053:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788846244.677270:0:22626:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1788846244.677944:0:22626:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788846244.678146:0:22626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788846244.678154:0:22626:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788846244.678165:0:22626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138273333 00000020:01000004:2.0:1788846244.678171:0:22626:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788846244.678175:0:22626:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788846244.678179:0:22626:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e474598800 from MGS 00000020:01000004:2.0:1788846244.678183:0:22626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788846244.678193:0:22626:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90e47b68b370) 00000020:00000080:2.0:1788846244.678202:0:22626:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788846244.678271:0:22626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e474598800 from MGS, refs=2 00080000:01000000:2.0:1788846244.678276:0:22626:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788846244.678284:0:22626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138273341 00000100:00100000:2.0:1788846244.678370:0:22626:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788846244.678565:0:22626:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788846244.678571:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788846244.678973:0:22626:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788846244.678980:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788846244.679733:0:22626:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788846244.679903:0:22626:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788846244.679909:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788846244.681038:0:22626:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788846244.681047:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788846244.681324:0:22626:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788846244.681330:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788846244.682136:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846244.682140:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846244.682142:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846244.682390:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846244.682392:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846244.682394:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846244.683292:0:22626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788846244.684777:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788846244.688108:0:22626:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788846244.693937:0:22638:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788846244.694098:0:22626:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788846244.694165:0:22626:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788846244.698477:0:22626:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788846244.698820:0:22626:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788846244.699006:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788846244.699013:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788846244.701994:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788846244.702006:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788846244.702758:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788846244.702766:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788846244.706316:0:22626:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788846244.706339:0:22626:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.120@tcp' 00000020:01000004:0.0:1788846244.706341:0:22626:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788846244.706372:0:22626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.120@tcp (typ=mgc) 00000020:00000080:0.0:1788846244.706386:0:22626:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.120@tcp (ffff90e449bd99b8) 00000020:00000080:0.0:1788846244.706400:0:22626:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788846244.706485:0:22626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e469b1c800@MGC192.168.203.120@tcp: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788846244.706670:0:22626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.120@tcp-0 is initialized 00000040:01000000:0.0:1788846244.706676:0:22626:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788846244.707348:0:22643:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788846244.707671:0:22644:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788846244.707755:0:22626:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.120@tcp (uuid 7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa) 00000020:00000080:3.0:1788846244.707774:0:22626:0:(genops.c:1385:class_connect()) connect: client 7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa, cookie 0x21b4d5613827334f 00000100:00080000:3.0:1788846244.707785:0:22626:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788846244.707790:0:22626:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff90e469b1c800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846244.707822:0:22626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745ced80 x1875740702495360/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846244.707909:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3639:1875740702495360:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788846244.707973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846244.708066:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702495360 00000100:00100000:0.0:1788846244.708073:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702495360 00000100:00100000:0.0:1788846244.708107:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846244.708115:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1875740702495360:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788846244.708137:0:22640:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa@0@lo t0 exp 0000000000000000 cur 628 last 0 00000020:00000080:0.0:1788846244.708161:0:22640:0:(genops.c:1385:class_connect()) connect: client 7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa, cookie 0x21b4d56138273356 00000100:00080000:0.0:1788846244.708345:0:22640:0:(import.c:65:import_set_state_nolock()) ffff90e469b1a000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788846244.708650:0:22626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa->MGS 00000020:01000004:3.0:1788846244.708669:0:22626:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788846244.708695:0:22626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788846244.708708:0:22626:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90e341e54d28) 00000020:00000080:3.0:1788846244.708718:0:22626:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788846244.713955:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+5:3639:x1875740702495360:12345-0@lo:250:mount.lustre.0 Request processed in 5819us (5961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846244.713989:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788846244.714178:0:3639:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788846244.714190:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.120@tcp: connect to target with instance 0 00000100:00080000:1.0:1788846244.714198:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788846244.714203:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788846244.714208:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e469b1c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788846244.714211:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788846244.714225:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788846244.714232:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3639:1875740702495360:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788846244.720162:0:22626:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788846244.721894:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788846244.721905:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788846244.729119:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788846244.729134:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788846244.732758:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788846244.732773:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788846244.735346:0:22626:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788846244.736066:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788846244.736074:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788846244.737963:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788846244.737975:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788846244.798940:0:22626:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846244.799263:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788846244.799269:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788846244.801010:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788846244.801022:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788846244.803995:0:22626:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846244.804172:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788846244.804178:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788846244.805461:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788846244.805474:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788846244.810290:0:22626:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846244.810480:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788846244.810486:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788846244.813452:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788846244.813465:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788846244.817796:0:22626:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846244.818572:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788846244.818581:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788846244.819134:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788846244.819142:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788846244.840898:0:22626:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788846244.841112:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788846244.841118:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788846244.843284:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788846244.843296:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788846244.845861:0:22626:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788846244.845873:0:22626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788846244.846886:0:22626:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788846244.846913:0:22626:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788846244.846918:0:22626:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788846244.847032:0:22626:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788846244.847065:0:22626:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788846244.847073:0:22626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788846244.847074:0:22626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788846244.847076:0:22626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846244.847077:0:22626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846244.847078:0:22626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846244.847079:0:22626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846244.847080:0:22626:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788846244.847081:0:22626:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788846244.847082:0:22626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846244.847083:0:22626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788846244.847086:0:22626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788846244.847088:0:22626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788846244.847089:0:22626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788846244.847090:0:22626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846244.847091:0:22626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846244.847092:0:22626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846244.847093:0:22626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846244.847094:0:22626:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788846244.847095:0:22626:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788846244.847096:0:22626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846244.847097:0:22626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788846244.847122:0:22626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788846244.847140:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702495488:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788846244.847220:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846244.847264:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442ec3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846244.847554:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702495488 00000100:00100000:2.0:1788846244.847562:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702495488 00000100:00100000:2.0:1788846244.847597:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788846244.847606:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+5:22626:x1875740702495488:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788846244.847653:0:22642:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788846244.847657:0:22642:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788846244.847660:0:22642:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788846244.848254:0:22663:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788846244.848847:0:22642:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1788846244.850769:0:22664:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788846244.850775:0:22664:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788846244.850778:0:22664:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788846244.850781:0:22664:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788846244.851114:0:22664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788846244.851452:0:22642:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788846244.851463:0:22642:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788846244.865871:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+5:22626:x1875740702495488:12345-0@lo:253:mount.lustre.0 Request processed in 18257us (18642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846244.865889:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846244.866005:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702495488:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788846244.866021:0:22626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788846244.866024:0:22626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788846244.866025:0:22626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788846244.866026:0:22626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846244.866028:0:22626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846244.866029:0:22626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846244.866029:0:22626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846244.866031:0:22626:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788846244.866032:0:22626:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788846244.866034:0:22626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846244.866035:0:22626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788846244.866066:0:22626:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e474598800 from lustre-MDT0000 10000000:01000000:0.0:1788846244.866095:0:22626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788846244.866098:0:22626:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788846244.866102:0:22626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90e449bd99b8 10000000:01000000:0.0:1788846244.866107:0:22626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788846244.866115:0:22626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90e449bd99b8 from 1 10000000:01000000:0.0:1788846244.866118:0:22626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788846244.866153:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846244.866174:0:22626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846244.866184:0:22626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846244.866202:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702495616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788846244.866240:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846244.866277:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442ec3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788846244.866831:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702495616 00000100:00100000:1.0:1788846244.866838:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702495616 00000100:00100000:1.0:1788846244.866885:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788846244.866894:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+5:22626:x1875740702495616:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846244.866908:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846244.866923:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e440031400/0x21b4d5613827336b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273364 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846244.866962:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440031400/0x21b4d5613827336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273364 expref: 6 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846244.866972:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e440031400/0x21b4d5613827336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273364 expref: 6 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846244.866991:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031400, rc 0) 00000100:00100000:1.0:1788846244.867047:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+6:22626:x1875740702495616:12345-0@lo:101:mount.lustre.0 Request processed in 154us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846244.867054:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788846244.867143:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702495616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846244.867155:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846244.867175:0:22626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846244.867242:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702495744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846244.867267:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846244.867302:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4517f9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788846244.867441:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702495744 00000100:00100000:1.0:1788846244.867446:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702495744 00000100:00100000:1.0:1788846244.867475:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788846244.867481:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+6:22626:x1875740702495744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846244.867587:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+6:22626:x1875740702495744:12345-0@lo:501:mount.lustre.0 Request processed in 105us (318us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788846244.867594:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788846244.867664:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702495744:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788846244.867699:0:22626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788846244.867716:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846244.867726:0:22626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846244.867735:0:22626:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e474598800 10000000:01000000:3.0:1788846244.867740:0:22626:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788846244.867744:0:22626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90e474598800 10000000:01000000:3.0:1788846244.867746:0:22626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788846244.867749:0:22626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90e474598800 from 1 10000000:01000000:3.0:1788846244.867751:0:22626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788846244.867783:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138273372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846244.867791:0:22626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138273372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846244.867799:0:22626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138273372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846244.867810:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702495872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846244.867837:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846244.867854:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63000 going to sleep for 11 seconds 00000100:00100000:1.0:1788846244.867916:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702495872 00000100:00100000:1.0:1788846244.867921:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702495872 00000100:00100000:1.0:1788846244.867938:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788846244.867943:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+6:22626:x1875740702495872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846244.867950:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846244.867961:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e440031000/0x21b4d56138273379 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273372 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846244.867974:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440031000/0x21b4d56138273379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273372 expref: 7 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846244.867994:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e440031000/0x21b4d56138273379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273372 expref: 7 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846244.868002:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031000, rc 0) 00000100:00100000:1.0:1788846244.868038:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+7:22626:x1875740702495872:12345-0@lo:101:mount.lustre.0 Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846244.868044:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788846244.868111:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702495872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846244.868121:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138273372 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273379 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846244.868129:0:22626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138273372 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273379 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846244.868140:0:22626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788846244.868154:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138273372 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273379 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846244.868170:0:22626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138273372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273379 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846244.868176:0:22626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788846244.868180:0:22626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788846244.868184:0:22626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90e474598800 10000000:01000000:3.0:1788846244.868192:0:22626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788846244.868196:0:22626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788846244.868197:0:22626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788846244.868212:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138273380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846244.868218:0:22626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138273380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846244.868224:0:22626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138273380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846244.868234:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702496000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846244.868258:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846244.868270:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63000 going to sleep for 11 seconds 00000100:00100000:1.0:1788846244.868446:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702496000 00000100:00100000:1.0:1788846244.868451:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702496000 00000100:00100000:1.0:1788846244.868471:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788846244.868477:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+7:22626:x1875740702496000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846244.868484:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846244.868491:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e440030600/0x21b4d56138273387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273380 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846244.868517:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440030600/0x21b4d56138273387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273380 expref: 8 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846244.868556:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e440030600/0x21b4d56138273387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273380 expref: 8 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846244.868563:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440030600, rc 0) 00000100:00100000:1.0:1788846244.868588:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+8:22626:x1875740702496000:12345-0@lo:101:mount.lustre.0 Request processed in 112us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846244.868595:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788846244.868663:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702496000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846244.868672:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138273380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273387 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846244.868681:0:22626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138273380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273387 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846244.868739:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702496128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846244.868763:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846244.868789:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63000 going to sleep for 11 seconds 00000100:00100000:2.0:1788846244.868850:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702496128 00000100:00100000:2.0:1788846244.868854:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702496128 00000100:00100000:2.0:1788846244.868873:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846244.868878:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+8:22626:x1875740702496128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846244.868993:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+9:22626:x1875740702496128:12345-0@lo:501:mount.lustre.0 Request processed in 114us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846244.869000:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788846244.869075:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702496128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846244.869100:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702496256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846244.869135:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846244.869168:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63000 going to sleep for 11 seconds 00000100:00100000:0.0:1788846244.869292:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702496256 00000100:00100000:0.0:1788846244.869306:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702496256 00000100:00100000:0.0:1788846244.869323:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788846244.869329:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+9:22626:x1875740702496256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846244.869940:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+9:22626:x1875740702496256:12345-0@lo:503:mount.lustre.0 Request processed in 608us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846244.869948:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788846244.870041:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702496256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846244.870702:0:22665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22665:1875740702496384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846244.870746:0:22665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846244.870779:0:22665:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846244.870832:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702496384 00000100:00100000:1.0:1788846244.870839:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702496384 00000100:00100000:1.0:1788846244.870886:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788846244.870895:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+9:22665:x1875740702496384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788846244.872782:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+9:22665:x1875740702496384:12345-0@lo:502:llog_process_th.0 Request processed in 1882us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846244.872803:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788846244.873834:0:22665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22665:1875740702496384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788846244.873871:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846244.873883:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846244.873885:0:22665:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788846244.873891:0:22665:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788846244.873894:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788846244.873908:0:22665:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90e341e519b8) 00000020:00000080:3.0:1788846244.873925:0:22665:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788846244.873930:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788846244.874013:0:22665:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788846244.874020:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138273395 00000020:00000080:3.0:1788846244.874222:0:22665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788846244.874227:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846244.874230:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846244.874231:0:22665:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788846244.874234:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846244.874237:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846244.874238:0:22665:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788846244.874241:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788846244.874247:0:22665:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90e341e53370) 00000020:00000080:3.0:1788846244.874256:0:22665:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788846244.874258:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788846244.874261:0:22665:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788846244.874263:0:22665:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788846244.874268:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788846244.874316:0:22665:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e474598800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788846244.874326:0:22665:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90e341e50000) 00000020:00000080:3.0:1788846244.874341:0:22665:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788846244.874399:0:22665:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788846244.874404:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d561382733aa 00000020:00000080:3.0:1788846244.874494:0:22665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788846244.874500:0:22665:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788846244.874515:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x21b4d561382733b1 00080000:01000000:3.0:1788846244.874555:0:22665:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788846244.874559:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d561382733b8 00010000:00010000:3.0:1788846244.990982:0:22665:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788846244.992134:0:22665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:3.0:1788846244.992612:0:22665:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788846244.993095:0:22665:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90e34387b370) 00000020:00000080:3.0:1788846244.993114:0:22665:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788846244.993268:0:22665:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788846244.993277:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d561382733c6 00000020:00000080:1.0:1788846244.998639:0:22665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788846245.012111:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x21b4d561382733cd 00000020:00000080:2.0:1788846245.017568:0:22665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788846245.017584:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846245.017596:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846245.017598:0:22665:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788846245.017602:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788846245.017605:0:22665:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788846245.017607:0:22665:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788846245.017609:0:22665:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788846245.017610:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788846245.017613:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846245.017615:0:22665:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788846245.017617:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846245.017623:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846245.017624:0:22665:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788846245.017629:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788846245.017687:0:22665:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788846245.017709:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846245.017726:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846245.017728:0:22665:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788846245.017731:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846245.017735:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846245.017736:0:22665:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788846245.017739:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788846245.017744:0:22665:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:2.0:1788846245.017772:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788846245.017788:0:22665:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff90e47b6899b8) 00000020:00000080:2.0:1788846245.017807:0:22665:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788846245.017813:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788846245.017871:0:22665:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788846245.017877:0:22665:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788846245.017882:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d561382733db 00010000:00080000:2.0:1788846245.017924:0:22665:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e458353800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1788846245.021947:0:22665:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788846245.023454:0:22665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788846245.023468:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788846245.023567:0:22665:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788846245.023587:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d561382733e2 00000100:00080000:0.0:1788846245.023601:0:22665:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846245.023607:0:22665:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90e458353800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846245.023639:0:22665:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745eed80 x1875740702496512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846245.023662:0:22665:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788846245.023739:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846245.023743:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846245.023744:0:22665:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788846245.023748:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788846245.023751:0:22665:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788846245.023753:0:22665:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788846245.023754:0:22665:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788846245.023755:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788846245.023758:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846245.023759:0:22665:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788846245.023762:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788846245.023767:0:22665:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788846245.023770:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846245.023772:0:22665:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788846245.023775:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788846245.023778:0:22665:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:0.0:1788846245.023802:0:22665:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788846245.023805:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788846245.023817:0:22665:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90e449bd8000) 00000020:00000080:0.0:1788846245.023829:0:22665:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788846245.023833:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788846245.023885:0:22665:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788846245.023891:0:22665:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788846245.023897:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d561382733f0 00010000:00080000:0.0:1788846245.023923:0:22665:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e474533800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.120@tcp at head 00000100:00100000:3.0:1788846245.024317:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702496512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788846245.024380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846245.024773:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702496512 00000100:00100000:3.0:1788846245.024780:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702496512 00000100:00100000:3.0:1788846245.024818:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788846245.024825:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702496512:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788846245.024841:0:22652:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788846245.028990:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3640:1875740702496640:0@lo:400:kworker.0 00000100:00100000:2.0:1788846245.029078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846245.029135:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702496640 00000100:00100000:2.0:1788846245.029142:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702496640 00000100:00100000:2.0:1788846245.029373:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846245.029383:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+9:3640:x1875740702496640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846245.029433:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+9:3640:x1875740702496640:12345-0@lo:400:kworker.0 Request processed in 53us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846245.029440:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846245.029497:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3640:1875740702496640:0@lo:400:kworker.0 00010000:00010000:0.0:1788846245.038629:0:22665:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788846245.044667:0:22665:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788846245.046316:0:22665:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788846245.048707:0:22665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788846245.055330:0:22665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788846245.071744:0:22665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1788846245.072308:0:22671:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788846245.072313:0:22671:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788846245.073080:0:22665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788846245.073092:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788846245.073126:0:22665:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788846245.073151:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d561382733f7 00000100:00080000:2.0:1788846245.073172:0:22665:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788846245.073179:0:22665:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90e474533800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846245.073216:0:22665:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e448f84700 x1875740702496768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788846245.073248:0:22665:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788846245.073312:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846245.073316:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846245.073318:0:22665:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788846245.073321:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788846245.073324:0:22665:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788846245.073325:0:22665:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788846245.073327:0:22665:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788846245.073328:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788846245.073330:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846245.073331:0:22665:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788846245.073334:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788846245.073338:0:22665:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788846245.073341:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846245.073342:0:22665:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788846245.073345:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788846245.073349:0:22665:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:2.0:1788846245.073374:0:22665:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788846245.073377:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788846245.073388:0:22665:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90e47b68cd28) 00000020:00000080:2.0:1788846245.073400:0:22665:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788846245.073405:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788846245.073464:0:22665:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788846245.073470:0:22665:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788846245.073475:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138273405 00010000:00080000:2.0:1788846245.073514:0:22665:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e343be3000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1788846245.073738:0:22665:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788846245.073797:0:22665:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788846245.073809:0:22665:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788846245.074005:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702496768:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788846245.074066:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702496768 offset 0 length 520: 4 00000100:00100000:2.0:1788846245.075353:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702496512:12345-0@lo:38:llog_process_th.0 Request processed in 50520us (50965us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788846245.075369:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788846245.075463:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458353800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846245.075468:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788846245.075483:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702496512:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788846245.076918:0:22665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846245.077343:0:22665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788846245.077508:0:22665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1788846245.078036:0:22673:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788846245.078042:0:22673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788846245.079608:0:22665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788846245.079624:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788846245.079669:0:22665:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788846245.079688:0:22665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d5613827340c 00000100:00080000:0.0:1788846245.079699:0:22665:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846245.079705:0:22665:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90e343be3000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846245.079751:0:22665:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745ece00 x1875740702496896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846245.079822:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702496896:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788846245.079873:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702496896 offset 0 length 520: 4 00000100:00080000:0.0:1788846245.079928:0:22665:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788846245.080347:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846245.080352:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846245.080354:0:22665:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788846245.080359:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846245.080362:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846245.080364:0:22665:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788846245.080366:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788846245.080368:0:22665:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788846245.080370:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846245.080372:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846245.080373:0:22665:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788846245.080376:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846245.080378:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846245.080379:0:22665:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788846245.080383:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788846245.080412:0:22665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22665:1875740702497024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788846245.080466:0:22665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846245.080541:0:22665:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e444c2ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788846245.080597:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702497024 00000100:00100000:2.0:1788846245.080604:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702497024 00000100:00100000:2.0:1788846245.080650:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788846245.080659:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+9:22665:x1875740702497024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788846245.080778:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+9:22665:x1875740702497024:12345-0@lo:502:llog_process_th.0 Request processed in 120us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846245.080786:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788846245.080835:0:22665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22665:1875740702497024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788846245.080858:0:22665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846245.080863:0:22665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846245.080864:0:22665:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788846245.080868:0:22665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788846245.080918:0:22626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788846245.080940:0:22626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788846245.080957:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138273380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273387 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.080967:0:22626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138273380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273387 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846245.080975:0:22626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e474598800 from 1 10000000:01000000:2.0:1788846245.080989:0:22626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788846245.081020:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.081029:0:22626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.081038:0:22626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846245.081050:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702497152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846245.081075:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846245.081094:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420840 going to sleep for 11 seconds 00000100:00100000:2.0:1788846245.081115:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702497152 00000100:00100000:2.0:1788846245.081119:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702497152 00000100:00100000:2.0:1788846245.081138:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788846245.081143:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+9:22626:x1875740702497152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846245.081151:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846245.081174:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aab400/0x21b4d5613827341a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273413 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.081200:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aab400/0x21b4d5613827341a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273413 expref: 10 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.081211:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aab400/0x21b4d5613827341a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273413 expref: 10 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.081220:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aab400, rc 0) 00000100:00100000:2.0:1788846245.081246:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+10:22626:x1875740702497152:12345-0@lo:101:mount.lustre.0 Request processed in 102us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846245.081252:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788846245.081288:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702497152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846245.081298:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.081308:0:22626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846245.081888:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702497280:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788846245.081923:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846245.081938:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420840 going to sleep for 11 seconds 00000100:00100000:2.0:1788846245.081956:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702497280 00000100:00100000:2.0:1788846245.081959:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702497280 00000100:00100000:2.0:1788846245.081980:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788846245.081986:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+10:22626:x1875740702497280:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788846245.081999:0:22641:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788846245.082005:0:22641:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788846245.082057:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+10:22626:x1875740702497280:12345-0@lo:256:mount.lustre.0 Request processed in 71us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846245.082063:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788846245.082094:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702497280:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788846245.082653:0:22626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788846245.082669:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.082678:0:22626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846245.082737:0:22626:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e474598800 from 1 10000000:01000000:2.0:1788846245.082740:0:22626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788846245.082764:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.082770:0:22626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.082779:0:22626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846245.082792:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702497408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846245.082822:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846245.082839:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420840 going to sleep for 11 seconds 00000100:00100000:2.0:1788846245.082865:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702497408 00000100:00100000:2.0:1788846245.082869:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702497408 00000100:00100000:2.0:1788846245.082896:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788846245.082902:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+10:22626:x1875740702497408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846245.082911:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846245.082921:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aaa600/0x21b4d56138273428 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273421 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.082937:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aaa600/0x21b4d56138273428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273421 expref: 11 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.082945:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aaa600/0x21b4d56138273428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273421 expref: 11 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.082964:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa600, rc 0) 00000100:00100000:2.0:1788846245.083000:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:22626:x1875740702497408:12345-0@lo:101:mount.lustre.0 Request processed in 98us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846245.083006:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788846245.083041:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702497408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846245.083052:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.083060:0:22626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846245.083109:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702497536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846245.083132:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846245.083145:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420840 going to sleep for 11 seconds 00000100:00100000:2.0:1788846245.083158:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702497536 00000100:00100000:2.0:1788846245.083161:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702497536 00000100:00100000:2.0:1788846245.083183:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788846245.083189:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:22626:x1875740702497536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846245.083309:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:22626:x1875740702497536:12345-0@lo:501:mount.lustre.0 Request processed in 119us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846245.083316:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788846245.083346:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702497536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846245.083373:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702497664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846245.084150:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846245.084292:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420840 going to sleep for 11 seconds 00000100:00100000:0.0:1788846245.084408:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702497664 00000100:00100000:0.0:1788846245.084415:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702497664 00000100:00100000:0.0:1788846245.084493:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788846245.084512:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:22626:x1875740702497664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846245.084668:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:22626:x1875740702497664:12345-0@lo:503:mount.lustre.0 Request processed in 167us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846245.084674:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788846245.084833:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702497664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846245.085365:0:22675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22675:1875740702497792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846245.085416:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846245.085494:0:22675:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45033ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846245.085639:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702497792 00000100:00100000:0.0:1788846245.085645:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702497792 00000100:00100000:0.0:1788846245.085684:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788846245.085695:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:22675:x1875740702497792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788846245.086403:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:22675:x1875740702497792:12345-0@lo:502:llog_process_th.0 Request processed in 709us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846245.086464:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788846245.086610:0:22675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22675:1875740702497792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788846245.086640:0:22675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846245.086649:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846245.086652:0:22675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788846245.086659:0:22675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e474598800 00000020:00000080:3.0:1788846245.086662:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846245.086671:0:22675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846245.086673:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846245.086675:0:22675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788846245.086677:0:22675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846245.086679:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846245.086681:0:22675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788846245.086684:0:22675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e474598800 00000020:00000080:3.0:1788846245.086685:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846245.086742:0:22675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846245.086745:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846245.086747:0:22675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788846245.086749:0:22675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846245.086751:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846245.086752:0:22675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788846245.086756:0:22675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e474598800 00000020:00000080:3.0:1788846245.086758:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846245.086774:0:22675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846245.086777:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846245.086778:0:22675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788846245.086780:0:22675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846245.086782:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846245.086784:0:22675:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788846245.086787:0:22675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e474598800 00000020:00000080:3.0:1788846245.086789:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788846245.086838:0:22675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22675:1875740702497920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846245.086880:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846245.086906:0:22675:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45033ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846245.088154:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702497920 00000100:00100000:1.0:1788846245.088174:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702497920 00000100:00100000:1.0:1788846245.088223:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788846245.088232:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:22675:x1875740702497920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788846245.088366:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:22675:x1875740702497920:12345-0@lo:502:llog_process_th.0 Request processed in 135us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846245.088373:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788846245.088609:0:22675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22675:1875740702497920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788846245.088640:0:22675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846245.088647:0:22675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846245.088649:0:22675:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788846245.088653:0:22675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788846245.089590:0:22626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788846245.089619:0:22626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788846245.089640:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.089651:0:22626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846245.089704:0:22626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788846245.089707:0:22626:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e474598800 10000000:01000000:3.0:1788846245.089710:0:22626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e474598800 10000000:01000000:3.0:1788846245.089715:0:22626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788846245.089721:0:22626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e474598800 from 1 10000000:01000000:3.0:1788846245.089723:0:22626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788846245.089755:0:22626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42cc00/0x21b4d5613827342f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.089764:0:22626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42cc00/0x21b4d5613827342f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.089774:0:22626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42cc00/0x21b4d5613827342f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846245.089808:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702498048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846245.089861:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846245.089901:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45033ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788846245.090037:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702498048 00000100:00100000:1.0:1788846245.090049:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702498048 00000100:00100000:1.0:1788846245.090090:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788846245.090098:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:22626:x1875740702498048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846245.090108:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846245.090121:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e440031e00/0x21b4d56138273436 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827342f expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846245.090144:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440031e00/0x21b4d56138273436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827342f expref: 12 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846245.090155:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e440031e00/0x21b4d56138273436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827342f expref: 12 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846245.090271:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031e00, rc 0) 00000100:00100000:1.0:1788846245.090315:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22626:x1875740702498048:12345-0@lo:101:mount.lustre.0 Request processed in 218us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846245.090322:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788846245.090400:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702498048:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846245.090413:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42cc00/0x21b4d5613827342f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273436 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.090421:0:22626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42cc00/0x21b4d5613827342f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273436 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846245.090470:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702498176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846245.090517:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846245.090563:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45033ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788846245.090671:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702498176 00000100:00100000:1.0:1788846245.090676:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702498176 00000100:00100000:1.0:1788846245.090715:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788846245.090723:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22626:x1875740702498176:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846245.090828:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22626:x1875740702498176:12345-0@lo:501:mount.lustre.0 Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846245.090836:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788846245.090907:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702498176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846245.090933:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702498304:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846245.090972:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846245.091124:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45033ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788846245.091242:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702498304 00000100:00100000:1.0:1788846245.091247:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702498304 00000100:00100000:1.0:1788846245.091278:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788846245.091285:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22626:x1875740702498304:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846245.091370:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22626:x1875740702498304:12345-0@lo:503:mount.lustre.0 Request processed in 85us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846245.091377:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788846245.091458:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702498304:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846245.093233:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22677:1875740702498432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846245.093304:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846245.093347:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4494ddc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846245.093390:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702498432 00000100:00100000:2.0:1788846245.093397:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702498432 00000100:00100000:2.0:1788846245.093763:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788846245.093773:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22677:x1875740702498432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788846245.093895:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22677:x1875740702498432:12345-0@lo:502:llog_process_th.0 Request processed in 124us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846245.093902:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788846245.093953:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22677:1875740702498432:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788846245.094270:0:22677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788846245.094285:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90e47b688000) 00000020:00000080:2.0:1788846245.094304:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788846245.094383:0:22677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e474598800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788846245.094387:0:22677:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e474598800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788846245.094389:0:22677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e474598800 4 00010000:00080000:2.0:1788846245.094427:0:22677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e47d368000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1788846245.100474:0:22677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788846245.100812:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788846245.100854:0:22677:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788846245.100868:0:22677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x21b4d56138273444 00000100:00080000:2.0:1788846245.100880:0:22677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788846245.100885:0:22677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90e47d368000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846245.100920:0:22677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e448f86a00 x1875740702498560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846245.100957:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702498560:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846245.101023:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846245.101095:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702498560 00000100:00100000:2.0:1788846245.101105:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702498560 00000100:00100000:2.0:1788846245.101136:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846245.101144:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702498560:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846245.101190:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702498560:12345-0@lo:38:llog_process_th.0 Request processed in 46us (167us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788846245.101197:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846245.101228:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846245.101235:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47d368000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846245.101247:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788846245.101251:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702498560:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788846245.101281:0:22677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788846245.102848:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22677:1875740702498688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788846245.102915:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846245.102946:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846245.102966:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702498688 00000100:00100000:2.0:1788846245.102972:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702498688 00000100:00100000:2.0:1788846245.103025:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788846245.103034:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22677:x1875740702498688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788846245.103146:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22677:x1875740702498688:12345-0@lo:502:llog_process_th.0 Request processed in 113us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846245.103154:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788846245.103725:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22677:1875740702498688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788846245.103775:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22677:1875740702498816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788846245.103813:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846245.103838:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702498816 00000100:00100000:2.0:1788846245.103849:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702498816 00000100:00100000:2.0:1788846245.103877:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788846245.103883:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22677:x1875740702498816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788846245.104010:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22677:x1875740702498816:12345-0@lo:502:llog_process_th.0 Request processed in 125us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846245.104017:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788846245.104053:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420600 going to sleep for 11 seconds 00000100:00100000:2.0:1788846245.104065:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22677:1875740702498816:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788846245.104082:0:22677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788846245.104138:0:22626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788846245.106389:0:22626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788846245.106417:0:22626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42cc00/0x21b4d5613827342f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273436 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.106430:0:22626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42cc00/0x21b4d5613827342f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273436 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788846245.106560:0:22626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788846245.106562:0:22626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788846245.106563:0:22626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846245.106564:0:22626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846245.106566:0:22626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846245.106567:0:22626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846245.106568:0:22626:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788846245.106570:0:22626:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788846245.106571:0:22626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846245.106573:0:22626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788846245.106576:0:22626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788846245.106579:0:22626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788846245.106580:0:22626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788846245.106581:0:22626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846245.106582:0:22626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846245.106588:0:22626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846245.106589:0:22626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846245.106590:0:22626:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788846245.106591:0:22626:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788846245.106592:0:22626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846245.106593:0:22626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788846245.106615:0:22626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788846245.106633:0:22626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702498944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788846245.106692:0:22626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846245.106728:0:22626:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420600 going to sleep for 11 seconds 00000100:00100000:2.0:1788846245.106757:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702498944 00000100:00100000:2.0:1788846245.106763:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702498944 00000100:00100000:2.0:1788846245.106802:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788846245.106810:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22626:x1875740702498944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788846245.106833:0:22642:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788846245.106846:0:22642:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788846245.109484:0:22642:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788846245.109509:0:22642:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788846245.109776:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22626:x1875740702498944:12345-0@lo:253:mount.lustre.0 Request processed in 2962us (3079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846245.109788:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788846245.109850:0:22626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22626:1875740702498944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788846245.109863:0:22626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788846245.109866:0:22626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788846245.109867:0:22626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788846245.109868:0:22626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846245.109870:0:22626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846245.109871:0:22626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846245.109873:0:22626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846245.109874:0:22626:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788846245.109875:0:22626:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788846245.109878:0:22626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846245.109879:0:22626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788846245.109903:0:22626:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788846245.110117:0:22663:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788846245.110122:0:22663:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788846245.110143:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.110233:0:22663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342aab400/0x21b4d5613827341a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273413 expref: 11 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.110243:0:22663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.110279:0:22663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342aab400/0x21b4d5613827341a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138273413 expref: 11 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.110293:0:22663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342aab400/0x21b4d5613827341a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138273413 expref: 11 pid: 22641 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846245.110306:0:22663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702499072:0@lo:104: 00000100:00100000:3.0:1788846245.110343:0:22663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846245.110374:0:22663:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45033e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788846245.118385:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702499072 00000100:00100000:2.0:1788846245.118395:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702499072 00000100:00100000:2.0:1788846245.118441:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846245.118450:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+3:22663:x1875740702499072:12345-0@lo:104: 00010000:00010000:2.0:1788846245.118468:0:22630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.118678:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788846245.118685:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+3:22663:x1875740702499072:12345-0@lo:104: Request processed in 237us (8342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846245.118696:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846245.119115:0:22663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702499072:0@lo:104: 00010000:00010000:2.0:1788846245.119139:0:22663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.120630:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846245.120643:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.120654:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa200 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846245.120658:0:22636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.120668:0:22636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846245.120675:0:22636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846245.120693:0:22636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788846245.120736:0:22636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.120743:0:22636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846245.120772:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.120781:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342aaa200/0x21b4d56138273413 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827341a expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846245.120797:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846245.120799:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846245.120800:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846245.121258:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702499200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846245.121320:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846245.124219:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702499200 00000100:00100000:0.0:1788846245.124233:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702499200 00010000:00010000:0.0:1788846245.124275:0:22632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342aab400/0x21b4d5613827341a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273413 expref: 12 pid: 22641 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846245.124333:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846245.124343:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:3641:x1875740702499200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788846245.124357:0:22632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846245.124364:0:22632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342aab400/0x21b4d5613827341a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273413 expref: 12 pid: 22641 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846245.124377:0:22632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342aab400/0x21b4d5613827341a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138273413 expref: 12 pid: 22641 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846245.124415:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aab400/0x21b4d5613827341a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138273413 expref: 12 pid: 22641 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846245.124433:0:22632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846245.124442:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788846245.124460:0:22632:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014338913s 00010000:00010000:0.0:1788846245.124465:0:22632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846245.124473:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846245.124480:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846245.124486:0:22632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846245.124493:0:22632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846245.124497:0:22632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846245.124514:0:22632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846245.124545:0:22632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846245.124564:0:22632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846245.124642:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:3641:x1875740702499200:12345-0@lo:103:ldlm_bl.0 Request processed in 300us (3321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846245.124649:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788846245.125140:0:22663:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.125150:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846245.125156:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42d200/0x21b4d5613827344b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846245.125197:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702499200:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788846245.137073:0:22626:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1788846245.138346:0:22626:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788846245.138679:0:22687:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:3.0:1788846245.138684:0:22687:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:0.0:1788846245.141700:0:22688:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788846245.141806:0:22626:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1788846245.143027:0:22689:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff90e4745ee680 x1875740702499328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846245.143041:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00000040:01000000:2.0:1788846245.144150:0:22626:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788846245.145756:0:22626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788846245.146196:0:22626:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788846245.146206:0:22626:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788846245.146246:0:22626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788846245.147303:0:22688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846245.149126:0:22626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788846245.149789:0:22626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788846245.149819:0:22626:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788846245.151147:0:22626:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788846245.151919:0:22626:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000040:00080000:0.0:1788846245.154290:0:22688:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788846245.154359:0:22688:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:2.0:1788846245.161550:0:22626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788846245.164444:0:22626:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788846245.164609:0:22626:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1f081c6f988 00100000:10000000:2.0:1788846245.164617:0:22626:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788846245.173021:0:22626:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788846245.173038:0:22626:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788846245.173055:0:22626:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788846245.173077:0:22626:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788846245.173738:0:22626:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788846245.173921:0:22626:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788846245.698378:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846246.140449:0:22683:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788846246.140459:0:22683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788846246.142267:0:22683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788846246.142280:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788846246.201873:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 10000000:01000000:2.0:1788846246.588993:0:22644:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788846246.589002:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e474598800 from 11 10000000:01000000:2.0:1788846246.589008:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788846246.589055:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846246.589064:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846246.589075:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846246.589099:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702499456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788846246.589168:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846246.589216:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341082240 going to sleep for 11 seconds 00000100:00100000:0.0:1788846246.589278:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702499456 00000100:00100000:0.0:1788846246.589286:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702499456 00000100:00100000:0.0:1788846246.589339:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788846246.589349:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+11:22644:x1875740702499456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846246.589361:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846246.589375:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0c600/0x21b4d56138273459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273452 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846246.589398:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0c600/0x21b4d56138273459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273452 expref: 12 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846246.589427:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0c600/0x21b4d56138273459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273452 expref: 12 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846246.589436:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0c600, rc 0) 00000100:00100000:0.0:1788846246.589487:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22644:x1875740702499456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846246.589503:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788846246.589623:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702499456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846246.589637:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846246.589646:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846246.589698:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702499584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788846246.589733:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846246.589775:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450b03540 going to sleep for 11 seconds 00000100:00100000:2.0:1788846246.589884:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702499584 00000100:00100000:2.0:1788846246.589888:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702499584 00000100:00100000:2.0:1788846246.589922:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788846246.589928:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22644:x1875740702499584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788846246.589950:0:22640:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788846246.589965:0:22640:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788846246.589969:0:22640:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788846246.590048:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:22644:x1875740702499584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846246.590055:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788846246.590084:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702499584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788846246.590126:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788846246.590132:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846246.590141:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846246.714443:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788846247.162839:0:22683:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788846247.162849:0:22683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788846247.163057:0:22683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1788846247.163094:0:22683:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788846247.163225:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788846247.227587:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788846247.738040:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846248.249583:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788846248.773084:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846249.281431:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788846249.797009:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788846250.045245:0:22932:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788846250.297622:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788846250.297629:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788846250.297632:0:37:0:(import.c:65:import_set_state_nolock()) ffff90e458353800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846250.297640:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 629 00000100:00080000:1.0:1788846250.297644:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788846250.297650:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90e458353800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846250.297672:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474540380 x1875740702499840/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846250.297696:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846250.297699:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846250.297701:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846250.297704:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846250.297706:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788846250.297709:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788846250.297710:0:37:0:(import.c:65:import_set_state_nolock()) ffff90e47d368000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846250.297715:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90e47d368000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846250.297728:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474541f80 x1875740702499968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846250.297785:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702499712:0@lo:400:kworker.0 00000100:00100000:1.0:1788846250.297993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846250.298073:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702499712 00000100:00100000:1.0:1788846250.298081:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702499712 00000100:00100000:1.0:1788846250.298119:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788846250.298128:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:3642:x1875740702499712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846250.298175:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:3642:x1875740702499712:12345-0@lo:400:kworker.0 Request processed in 47us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846250.298182:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788846250.298227:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702499712:0@lo:400:kworker.0 00000100:00100000:3.0:1788846250.298315:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702499840:0@lo:38:kworker.0 00000100:00100000:3.0:1788846250.298370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846250.298388:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702499968:0@lo:38:kworker.0 00000100:00100000:3.0:1788846250.298440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846250.298638:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00000100:00100000:1.0:1788846250.298667:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702499840 00000100:00100000:1.0:1788846250.298672:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702499840 00000100:00100000:1.0:1788846250.298707:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788846250.298713:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875740702499840:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788846250.298731:0:22653:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788846250.298773:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875740702499840:12345-0@lo:38:kworker.0 Request processed in 58us (401us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788846250.298780:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788846250.299016:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458353800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846250.299021:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788846250.299025:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702499840:0@lo:38:kworker.0 00000100:00100000:0.0:1788846250.299982:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702499968 00000100:00100000:0.0:1788846250.299991:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702499968 00000100:00100000:0.0:1788846250.300074:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846250.300081:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702499968:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788846250.300103:0:22649:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 634 last 0 00000020:00000080:0.0:1788846250.300140:0:22649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x21b4d56138273460 00000004:00100000:0.0:1788846250.300156:0:22649:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788846250.300280:0:22649:0:(import.c:65:import_set_state_nolock()) ffff90e475021800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788846250.300353:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875740702499968:12345-0@lo:38:kworker.0 Request processed in 270us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846250.300360:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788846250.300438:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90e474541f80 x1875740702499968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788846250.300453:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788846250.300461:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788846250.300474:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788846250.300477:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47d368000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788846250.300482:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702499968:0@lo:38:kworker.0 00010000:00010000:0.0:1788846250.810074:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788846251.018167:0:22984:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788846251.018658:0:22984:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788846251.321661:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788846251.834568:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788846251.845128:0:23034:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788846251.845328:0:23034:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788846252.345630:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788846252.858001:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846253.369782:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788846253.883334:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846254.395468:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788846254.907254:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846255.418474:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846245/real 1788846245] req@ffff90e4745ece00 x1875740702496896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846255 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846255.418514:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e4745ece00 x1875740702496896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846255 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846255.418542:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846245/real 1788846245] req@ffff90e448f84700 x1875740702496768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846255 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846255.418555:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e448f84700 x1875740702496768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846255 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788846255.418574:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343be3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846255.418584:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788846255.418588:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702496896:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788846255.418593:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e474533800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846255.418598:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788846255.418600:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702496768:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788846255.422076:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00000100:00100000:1.0:1788846255.422308:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1788846255.424215:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788846255.424223:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788846255.424227:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e458353800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846255.424235:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 634 00000100:00080000:2.0:1788846255.424239:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788846255.424245:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90e458353800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846255.424278:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e448f85c00 x1875740702500224/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788846255.424299:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846255.424302:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788846255.424313:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e474533800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846255.424317:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 629 00000100:00080000:2.0:1788846255.424320:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788846255.424324:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90e474533800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846255.424338:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e448f85500 x1875740702500352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788846255.424347:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846255.424350:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788846255.424352:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e343be3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846255.424355:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 629 00000100:00080000:2.0:1788846255.424357:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788846255.424360:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90e343be3000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846255.424369:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e448f87100 x1875740702500480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846255.424417:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702500608:0@lo:400:kworker.0 00000100:00100000:2.0:1788846255.424490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846255.424579:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702500608 00000100:00100000:2.0:1788846255.424586:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702500608 00000100:00100000:2.0:1788846255.424624:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846255.424633:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702500608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846255.424682:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702500608:12345-0@lo:400:kworker.0 Request processed in 49us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846255.424689:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788846255.424725:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90e448f84a80 x1875740702500608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846255.424751:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702500608:0@lo:400:kworker.0 00000100:00100000:2.0:1788846255.424787:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702500224:0@lo:38:kworker.0 00000100:00100000:2.0:1788846255.424832:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846255.424858:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702500352:0@lo:8:kworker.0 00000400:00000100:2.0:1788846255.424891:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702500352 offset 0 length 520: 4 00000100:00100000:2.0:1788846255.424925:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702500480:0@lo:8:kworker.0 00000400:00000100:2.0:1788846255.424942:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702500480 offset 0 length 520: 4 00000100:00100000:2.0:1788846255.424963:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702500224 00000100:00100000:2.0:1788846255.424968:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702500224 00000100:00100000:2.0:1788846255.424988:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788846255.424993:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875740702500224:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788846255.425007:0:22653:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788846255.425040:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875740702500224:12345-0@lo:38:kworker.0 Request processed in 45us (207us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788846255.425047:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788846255.425071:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458353800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846255.425076:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788846255.425079:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702500224:0@lo:38:kworker.0 00000100:00100000:1.0:1788846255.430692:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702500096:0@lo:400:kworker.0 00000100:00100000:1.0:1788846255.430764:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846255.430867:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702500096 00000100:00100000:0.0:1788846255.430874:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702500096 00000100:00100000:0.0:1788846255.430938:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788846255.430948:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:3642:x1875740702500096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846255.431012:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:3642:x1875740702500096:12345-0@lo:400:kworker.0 Request processed in 65us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846255.431021:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788846255.431656:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702500096:0@lo:400:kworker.0 00010000:00010000:0.0:1788846255.930667:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846256.445503:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788846256.970027:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788846257.402466:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788846257.465938:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00000020:01000004:3.0:1788846257.977824:0:23379:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788846257.977828:0:23379:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788846257.977830:0:23379:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788846257.977947:0:23379:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90e47b586000 00000020:01000004:3.0:1788846257.977961:0:23379:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788846257.977972:0:23379:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788846257.977985:0:23379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff90e343878000) 00000020:00000080:3.0:1788846257.978000:0:23379:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1788846257.978253:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788846258.083370:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788846258.085965:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.088320:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788846258.088784:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788846258.089339:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788846258.090666:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788846258.090889:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788846258.091140:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788846258.091674:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788846258.091921:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788846258.092468:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788846258.092966:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788846258.093331:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788846258.093582:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788846258.095254:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.100845:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788846258.101301:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.101514:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788846258.101708:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.101871:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.102032:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.102488:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788846258.104372:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788846258.105022:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788846258.105368:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.105990:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.106362:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.106647:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.106887:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.107183:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788846258.107556:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.107813:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788846258.108132:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788846258.108377:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788846258.108655:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788846258.108850:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788846258.109255:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788846258.117027:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788846258.117632:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788846258.117888:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788846258.118747:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788846258.119477:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788846258.119746:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788846258.120144:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788846258.121374:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788846258.121742:0:23379:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00080000:01000000:2.0:1788846258.127054:0:23379:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788846258.129330:0:23379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788846258.129353:0:23379:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788846258.129367:0:23379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d5613827346e 00000020:01000004:2.0:1788846258.129375:0:23379:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788846258.129404:0:23379:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788846258.129408:0:23379:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788846258.129422:0:23379:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788846258.129452:0:23379:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788846258.129455:0:23379:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788846258.135288:0:23379:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788846258.135329:0:23379:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788846258.135334:0:23379:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788846258.135335:0:23379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788846258.135337:0:23379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846258.135338:0:23379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846258.135339:0:23379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846258.135341:0:23379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846258.135342:0:23379:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788846258.135344:0:23379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846258.135345:0:23379:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788846258.135349:0:23379:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788846258.135351:0:23379:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788846258.135353:0:23379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788846258.135354:0:23379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846258.135356:0:23379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846258.135357:0:23379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846258.135363:0:23379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846258.135364:0:23379:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788846258.135365:0:23379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846258.135366:0:23379:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788846258.135404:0:23379:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788846258.135433:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702500736:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788846258.135502:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846258.135617:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788846258.136936:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702500736 00000100:00100000:1.0:1788846258.136951:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702500736 00000100:00100000:1.0:1788846258.137007:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788846258.137017:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:23379:x1875740702500736:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788846258.137475:0:22641:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788846258.137480:0:22641:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788846258.137488:0:22641:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788846258.137896:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:23379:x1875740702500736:12345-0@lo:253:mount.lustre.0 Request processed in 878us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846258.137905:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788846258.137993:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702500736:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788846258.138006:0:23379:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788846258.138009:0:23379:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788846258.138010:0:23379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788846258.138012:0:23379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846258.138013:0:23379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846258.138014:0:23379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846258.138015:0:23379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846258.138017:0:23379:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788846258.138018:0:23379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846258.138020:0:23379:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788846258.138055:0:23379:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e47b586000 from lustre-MDT0001 10000000:01000000:2.0:1788846258.138086:0:23379:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788846258.138089:0:23379:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788846258.138095:0:23379:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90e449bd99b8 local copy 00010000:00010000:2.0:1788846258.138105:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846258.138214:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702500864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846258.138252:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846258.138287:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d1879c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846258.138487:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702500864 00000100:00100000:1.0:1788846258.138493:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702500864 00000100:00100000:1.0:1788846258.138565:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788846258.138573:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:23379:x1875740702500864:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846258.138646:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:23379:x1875740702500864:12345-0@lo:501:mount.lustre.0 Request processed in 74us (393us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788846258.138652:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788846258.139031:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702500864:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788846258.139179:0:23379:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788846258.139261:0:23379:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788846258.139278:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.139288:0:23379:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846258.139316:0:23379:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e47b586000 10000000:01000000:3.0:1788846258.139321:0:23379:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788846258.139326:0:23379:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90e449bd99b8 10000000:01000000:3.0:1788846258.139328:0:23379:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788846258.139332:0:23379:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90e449bd99b8 from 1 10000000:01000000:3.0:1788846258.139335:0:23379:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788846258.139360:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138273475 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.139368:0:23379:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138273475 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.139377:0:23379:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138273475 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846258.139403:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702500992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846258.139447:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846258.139477:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846258.139596:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702500992 00000100:00100000:1.0:1788846258.139601:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702500992 00000100:00100000:1.0:1788846258.139631:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788846258.139637:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+12:23379:x1875740702500992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846258.139646:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846258.139659:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e440031800/0x21b4d5613827347c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273475 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.139682:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440031800/0x21b4d5613827347c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273475 expref: 13 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.139705:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e440031800/0x21b4d5613827347c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273475 expref: 13 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.139714:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031800, rc 0) 00000100:00100000:1.0:1788846258.139754:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+13:23379:x1875740702500992:12345-0@lo:101:mount.lustre.0 Request processed in 117us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846258.139760:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788846258.139877:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702500992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846258.139888:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138273475 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827347c expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.139897:0:23379:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138273475 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827347c expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846258.139921:0:23379:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788846258.139937:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138273475 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827347c expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.139944:0:23379:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138273475 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827347c expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846258.139952:0:23379:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90e47b586000 10000000:01000000:3.0:1788846258.139955:0:23379:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788846258.139959:0:23379:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90e47b586000 from 1 10000000:01000000:3.0:1788846258.139961:0:23379:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788846258.139975:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d56138273483 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.139982:0:23379:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d56138273483 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.139989:0:23379:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d56138273483 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846258.140001:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846258.140025:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846258.140145:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702501120 00000100:00100000:0.0:1788846258.140150:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702501120 00000100:00100000:0.0:1788846258.140181:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788846258.140188:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+13:23379:x1875740702501120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846258.140195:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846258.140204:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0dc00/0x21b4d5613827348a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273483 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.140217:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0dc00/0x21b4d5613827348a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273483 expref: 14 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.140226:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0dc00/0x21b4d5613827348a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273483 expref: 14 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.140232:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0dc00, rc 0) 00000100:00100000:0.0:1788846258.140258:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+14:23379:x1875740702501120:12345-0@lo:101:mount.lustre.0 Request processed in 71us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846258.140264:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788846258.140321:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788846258.140333:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846258.140342:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d56138273483 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827348a expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.140350:0:23379:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d56138273483 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827348a expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846258.140367:0:23379:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788846258.140371:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d56138273483 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827348a expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.140377:0:23379:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d56138273483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827348a expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846258.140459:0:23379:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788846258.140463:0:23379:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788846258.140467:0:23379:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90e47b586000 10000000:01000000:3.0:1788846258.140469:0:23379:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788846258.140472:0:23379:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788846258.140475:0:23379:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788846258.140488:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d200/0x21b4d56138273491 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.140494:0:23379:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42d200/0x21b4d56138273491 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.140501:0:23379:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42d200/0x21b4d56138273491 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846258.140512:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846258.140564:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846258.140630:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846258.143881:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702501248 00000100:00100000:0.0:1788846258.143896:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702501248 00000100:00100000:0.0:1788846258.143951:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788846258.143961:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+14:23379:x1875740702501248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846258.143977:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846258.143995:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0d600/0x21b4d56138273498 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273491 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.144022:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0d600/0x21b4d56138273498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273491 expref: 15 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.144034:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0d600/0x21b4d56138273498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273491 expref: 15 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.144306:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0d600, rc 0) 00000100:00100000:3.0:1788846258.144496:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846258.144516:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42d200/0x21b4d56138273491 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273498 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.144556:0:23379:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d200/0x21b4d56138273491 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273498 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846258.145326:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+15:23379:x1875740702501248:12345-0@lo:101:mount.lustre.0 Request processed in 424us (3819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846258.145335:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000040:00080000:0.0:1788846258.148463:0:23379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1788846258.149850:0:23379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788846258.156687:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788846258.156745:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1788846258.156761:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1788846258.156773:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1788846258.156785:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1788846258.156797:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1788846258.156808:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1788846258.156820:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1788846258.156832:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1788846258.156845:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1788846258.156860:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1788846258.156874:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1788846258.156887:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1788846258.156899:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1788846258.156916:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1788846258.156930:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1788846258.156943:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1788846258.156957:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1788846258.156971:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1788846258.156984:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1788846258.156998:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1788846258.157010:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1788846258.157021:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1788846258.157034:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1788846258.158356:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1788846258.158375:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1788846258.158468:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1788846258.158485:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1788846258.158497:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1788846258.158511:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1788846258.158615:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1788846258.158631:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1788846258.158643:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1788846258.158655:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1788846258.158668:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1788846258.158679:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1788846258.158692:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1788846258.158705:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1788846258.158721:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1788846258.158738:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1788846258.158752:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1788846258.158769:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1788846258.158789:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1788846258.158807:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1788846258.158842:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1788846258.158847:0:23379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1788846258.158955:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846258.159023:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846258.159582:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685540 going to sleep for 11 seconds 00000100:00100000:3.0:1788846258.164436:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702501376 00000100:00100000:3.0:1788846258.164451:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702501376 00000100:00100000:3.0:1788846258.164704:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788846258.164716:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+15:23379:x1875740702501376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846258.164892:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+15:23379:x1875740702501376:12345-0@lo:501:mount.lustre.0 Request processed in 178us (5868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846258.164900:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788846258.164989:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846258.165039:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501504:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846258.165103:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846258.168442:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846258.172721:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702501504 00000100:00100000:0.0:1788846258.172737:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702501504 00000100:00100000:1.0:1788846258.172903:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788846258.172914:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+15:23379:x1875740702501504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846258.173792:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+15:23379:x1875740702501504:12345-0@lo:503:mount.lustre.0 Request processed in 876us (8685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846258.173800:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788846258.173911:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501504:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788846258.174364:0:23379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788846258.174465:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846258.174557:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846258.174586:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b6859c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846258.174754:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702501632 00000100:00100000:1.0:1788846258.174761:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702501632 00000100:00100000:1.0:1788846258.174788:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788846258.174795:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+15:23379:x1875740702501632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846258.175625:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+15:23379:x1875740702501632:12345-0@lo:502:mount.lustre.0 Request processed in 827us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846258.175635:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788846258.175835:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846258.176036:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788846258.176215:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1788846258.176232:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1788846258.176247:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1788846258.176262:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1788846258.176274:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1788846258.176286:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1788846258.176297:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1788846258.176309:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1788846258.176320:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1788846258.176331:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1788846258.176345:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1788846258.176361:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1788846258.176376:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1788846258.176405:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1788846258.176431:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1788846258.176448:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1788846258.176463:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1788846258.176475:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1788846258.176489:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1788846258.176503:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1788846258.176518:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1788846258.176556:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1788846258.176571:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1788846258.176586:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1788846258.176600:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1788846258.176615:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1788846258.176630:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1788846258.176658:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1788846258.176673:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1788846258.176686:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1788846258.176698:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1788846258.176709:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1788846258.176721:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1788846258.176732:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1788846258.176743:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1788846258.176754:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1788846258.176765:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1788846258.176777:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1788846258.176789:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1788846258.176800:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1788846258.176811:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1788846258.176823:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1788846258.176834:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1788846258.176867:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501760:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846258.176921:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846258.176963:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b6859c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846258.177177:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702501760 00000100:00100000:1.0:1788846258.177191:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702501760 00000100:00100000:1.0:1788846258.177223:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788846258.177230:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+15:23379:x1875740702501760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846258.177333:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+15:23379:x1875740702501760:12345-0@lo:502:mount.lustre.0 Request processed in 103us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846258.177340:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788846258.177488:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702501760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846258.180360:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1788846258.180396:0:23379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788846258.182610:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788846258.182624:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846258.182627:0:23383:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788846258.182634:0:23383:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788846258.182637:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788846258.182653:0:23383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff90e474c7b370) 00000020:00000080:1.0:1788846258.182675:0:23383:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788846258.182681:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788846258.182766:0:23383:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788846258.182773:0:23383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d561382734a6 00000020:00000080:1.0:1788846258.182961:0:23383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788846258.182965:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788846258.182969:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846258.182970:0:23383:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788846258.182973:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788846258.182976:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846258.182977:0:23383:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788846258.182980:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788846258.182987:0:23383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff90e474c7cd28) 00000020:00000080:1.0:1788846258.182998:0:23383:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788846258.183001:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788846258.183003:0:23383:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788846258.183005:0:23383:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788846258.183019:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788846258.183136:0:23383:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e47b586000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788846258.183149:0:23383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff90e474c78000) 00000020:00000080:1.0:1788846258.183159:0:23383:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788846258.183231:0:23383:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788846258.183237:0:23383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d561382734bb 00000020:00000080:1.0:1788846258.183325:0:23383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788846258.183331:0:23383:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788846258.183336:0:23383:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x21b4d561382734c2 00080000:01000000:1.0:1788846258.183341:0:23383:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788846258.183344:0:23383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d561382734c9 00010000:00010000:3.0:1788846258.280622:0:23383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788846258.282305:0:23383:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1788846258.283999:0:23383:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788846258.289925:0:23383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788846258.289939:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846258.289946:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.289949:0:23383:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788846258.289953:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846258.289958:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.289960:0:23383:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788846258.289963:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788846258.289968:0:23383:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:0.0:1788846258.290000:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788846258.290230:0:23383:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff90e449bdb370) 00000020:00000080:0.0:1788846258.290258:0:23383:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788846258.290266:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788846258.290361:0:23383:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788846258.290368:0:23383:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788846258.290375:0:23383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d561382734d7 00010000:00080000:0.0:1788846258.290488:0:23383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e458351000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1788846258.294956:0:23383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788846258.297810:0:23383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788846258.297825:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788846258.297868:0:23383:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788846258.297888:0:23383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d561382734de 00000100:00080000:0.0:1788846258.297898:0:23383:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846258.297904:0:23383:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90e458351000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846258.297937:0:23383:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745eea00 x1875740702501888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846258.297966:0:23383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788846258.298016:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788846258.298022:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788846258.298025:0:37:0:(import.c:65:import_set_state_nolock()) ffff90e458353800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846258.298032:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 639 00000100:00080000:3.0:1788846258.298036:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000020:01000000:0.0:1788846258.298040:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:3.0:1788846258.298041:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90e458353800 using connection 192.168.203.120@tcp/0@lo 00000020:00000080:0.0:1788846258.298047:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.298050:0:23383:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788846258.298054:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788846258.298058:0:23383:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788846258.298060:0:23383:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:3.0:1788846258.298062:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745ced80 x1875740702502016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:0.0:1788846258.298063:0:23383:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788846258.298067:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788846258.298074:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.298077:0:23383:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000100:00080000:3.0:1788846258.298079:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846258.298083:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788846258.298097:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846258.298110:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788846258.298165:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702502144:0@lo:400:kworker.0 00000100:00100000:3.0:1788846258.298229:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846258.298367:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702502144 00000100:00100000:1.0:1788846258.298375:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702502144 00000100:00100000:1.0:1788846258.298433:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788846258.298442:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702502144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846258.298500:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702502144:12345-0@lo:400:kworker.0 Request processed in 59us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846258.298508:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788846258.298564:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90e4745cc700 x1875740702502144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846258.298577:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702502144:0@lo:400:kworker.0 00000100:00100000:2.0:1788846258.298655:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702501888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846258.298695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846258.298725:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702502016:0@lo:38:kworker.0 00000100:00100000:2.0:1788846258.298743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788846258.298826:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1788846258.309734:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702501888 00000100:00100000:3.0:1788846258.309750:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702501888 00000100:00100000:3.0:1788846258.309782:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702502016 00000100:00100000:3.0:1788846258.309785:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702502016 00000100:00100000:3.0:1788846258.309800:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788846258.309809:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702501888:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788846258.309842:0:22652:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:3.0:1788846258.310315:0:22652:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d561382734e5 00000004:00100000:3.0:1788846258.310334:0:22652:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788846258.310339:0:22652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:00000080:3.0:1788846258.310493:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846258.310496:0:23383:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788846258.310509:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788846258.310609:0:23383:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788846258.310637:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846258.310641:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846258.310642:0:23383:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788846258.310645:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788846258.310648:0:23383:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788846258.310649:0:23383:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788846258.310651:0:23383:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788846258.310652:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788846258.310654:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846258.310655:0:23383:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788846258.310657:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788846258.310662:0:23383:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788846258.310672:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846258.310673:0:23383:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788846258.310676:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788846258.310680:0:23383:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:3.0:1788846258.310700:0:23383:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788846258.310703:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788846258.310717:0:23383:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90e34387cd28) 00000020:00000080:3.0:1788846258.310729:0:23383:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788846258.310734:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788846258.310803:0:23383:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788846258.310809:0:23383:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788846258.310816:0:23383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d561382734f3 00010000:00080000:3.0:1788846258.310844:0:23383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e47f429800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1788846258.311201:0:23383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1788846258.316403:0:23383:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:3.0:1788846258.317104:0:22652:0:(import.c:65:import_set_state_nolock()) ffff90e47f42a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846258.317201:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875740702501888:12345-0@lo:38:llog_process_th.0 Request processed in 7391us (18503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846258.317213:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788846258.317240:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788846258.317248:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702502016:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788846258.317290:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702502016:12345-0@lo:38:kworker.0 Request processed in 42us (18546us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788846258.317297:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788846258.317462:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846258.317471:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788846258.317480:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788846258.317485:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788846258.317488:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458351000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788846258.317510:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702501888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846258.317541:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846258.317547:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458353800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846258.317552:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788846258.317555:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702502016:0@lo:38:kworker.0 00000100:00100000:1.0:1788846258.317663:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788846258.321268:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702502272:0@lo:41:osp-pre-0-1.0 00000040:01000000:3.0:1788846258.321289:0:23383:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788846258.321370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788846258.323456:0:23383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846258.323770:0:23383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788846258.323914:0:23383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1788846258.325300:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702502272 00000100:00100000:0.0:1788846258.325312:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702502272 00000100:00100000:0.0:1788846258.325376:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788846258.325387:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875740702502272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788846258.325436:0:22653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788846258.325606:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875740702502272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 220us (4235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846258.325615:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788846258.325656:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702502272:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788846258.326182:0:23388:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788846258.326187:0:23388:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788846258.329343:0:23383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788846258.329355:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788846258.329401:0:23383:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788846258.329436:0:23383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d561382734fa 00000100:00080000:1.0:1788846258.329443:0:23383:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788846258.329448:0:23383:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90e47f429800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846258.329475:0:23383:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474540000 x1875740702502400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846258.329548:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702502400:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788846258.329591:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702502400 offset 0 length 520: 4 00000100:00080000:0.0:1788846258.329804:0:23383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788846258.329866:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846258.329869:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.329871:0:23383:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788846258.329873:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788846258.329875:0:23383:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788846258.329877:0:23383:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788846258.329877:0:23383:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788846258.329878:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788846258.329880:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.329881:0:23383:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788846258.329882:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788846258.329885:0:23383:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788846258.329887:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.329887:0:23383:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788846258.329889:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788846258.329892:0:23383:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:0.0:1788846258.329913:0:23383:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788846258.329916:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788846258.329929:0:23383:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90e449bdcd28) 00000020:00000080:0.0:1788846258.329941:0:23383:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788846258.329946:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788846258.330007:0:23383:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788846258.330014:0:23383:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788846258.330025:0:23383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d56138273508 00010000:00080000:0.0:1788846258.330069:0:23383:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e458351800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788846258.330275:0:23383:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788846258.330346:0:23383:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788846258.330360:0:23383:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788846258.330555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846258.330560:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788846258.330568:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846258.330571:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788846258.331815:0:23383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788846258.332032:0:23383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788846258.332133:0:23383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1788846258.332511:0:23390:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788846258.332517:0:23390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788846258.333287:0:23383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788846258.333296:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788846258.333330:0:23383:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788846258.333347:0:23383:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d5613827350f 00000100:00080000:0.0:1788846258.333356:0:23383:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846258.333361:0:23383:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e458351800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846258.333394:0:23383:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745ece00 x1875740702502528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846258.333430:0:23383:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788846258.333484:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1788846258.333489:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702502528:0@lo:8:llog_process_th.0 00000020:00000080:0.0:1788846258.333489:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.333491:0:23383:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788846258.333494:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846258.333497:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.333498:0:23383:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788846258.333501:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788846258.333503:0:23383:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788846258.333505:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846258.333507:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.333508:0:23383:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788846258.333510:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846258.333512:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.333513:0:23383:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788846258.333516:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000400:00000100:2.0:1788846258.333563:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702502528 offset 0 length 520: 4 00000100:00080000:3.0:1788846258.333698:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846258.333702:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788846258.333705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846258.333707:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788846258.333779:0:23383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846258.333784:0:23383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846258.333785:0:23383:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788846258.333789:0:23383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1788846258.334030:0:23379:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788846258.334059:0:23379:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788846258.334073:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d200/0x21b4d56138273491 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273498 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.334084:0:23379:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42d200/0x21b4d56138273491 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273498 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846258.334092:0:23379:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e47b586000 from 1 10000000:01000000:3.0:1788846258.334094:0:23379:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788846258.334119:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.334127:0:23379:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.334138:0:23379:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846258.334168:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702502656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846258.334210:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846258.334245:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450b03540 going to sleep for 11 seconds 00000100:00100000:1.0:1788846258.334298:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702502656 00000100:00100000:1.0:1788846258.334305:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702502656 00000100:00100000:1.0:1788846258.334344:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788846258.334351:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+15:23379:x1875740702502656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846258.334362:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846258.334373:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e440030200/0x21b4d5613827351d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273516 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.334403:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440030200/0x21b4d5613827351d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273516 expref: 16 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.334424:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e440030200/0x21b4d5613827351d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273516 expref: 16 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.334436:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440030200, rc 0) 00000100:00100000:1.0:1788846258.334485:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+16:23379:x1875740702502656:12345-0@lo:101:mount.lustre.0 Request processed in 134us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846258.334490:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788846258.334810:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702502656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846258.334834:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.334844:0:23379:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846258.335328:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702502784:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788846258.335369:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846258.335420:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b6853c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846258.335477:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702502784 00000100:00100000:2.0:1788846258.335482:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702502784 00000100:00100000:2.0:1788846258.335536:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788846258.335545:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+16:23379:x1875740702502784:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788846258.335565:0:22641:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788846258.335577:0:22641:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788846258.335579:0:22641:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788846258.335796:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+16:23379:x1875740702502784:12345-0@lo:256:mount.lustre.0 Request processed in 252us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846258.335804:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788846258.335868:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702502784:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788846258.336579:0:23379:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788846258.336597:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.336608:0:23379:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846258.336618:0:23379:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e47b586000 from 1 10000000:01000000:0.0:1788846258.336620:0:23379:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788846258.336646:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.336653:0:23379:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.336661:0:23379:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846258.336682:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702502912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788846258.336744:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846258.336773:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b6853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846258.337006:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702502912 00000100:00100000:1.0:1788846258.337013:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702502912 00000100:00100000:1.0:1788846258.337053:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788846258.337062:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+16:23379:x1875740702502912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846258.337200:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846258.337219:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e440030c00/0x21b4d5613827352b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273524 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.337241:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440030c00/0x21b4d5613827352b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273524 expref: 17 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.337252:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e440030c00/0x21b4d5613827352b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273524 expref: 17 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.337260:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440030c00, rc 0) 00000100:00100000:1.0:1788846258.337305:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:23379:x1875740702502912:12345-0@lo:101:mount.lustre.0 Request processed in 245us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846258.337311:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788846258.337464:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702502912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846258.337478:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.337488:0:23379:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846258.339988:0:23379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788846258.340262:0:23379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846258.340731:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788846258.340757:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788846258.340769:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788846258.340781:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788846258.340793:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788846258.340804:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788846258.340815:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788846258.340827:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788846258.340838:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788846258.340850:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788846258.341014:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788846258.341038:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788846258.341043:0:23379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788846258.341118:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846258.341186:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846258.341229:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187480 going to sleep for 11 seconds 00000100:00100000:1.0:1788846258.341301:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702503040 00000100:00100000:1.0:1788846258.341308:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702503040 00000100:00100000:1.0:1788846258.341976:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788846258.341989:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:23379:x1875740702503040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846258.342118:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:23379:x1875740702503040:12345-0@lo:501:mount.lustre.0 Request processed in 132us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846258.342126:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788846258.342206:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846258.342242:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846258.342288:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846258.342431:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187480 going to sleep for 11 seconds 00000100:00100000:3.0:1788846258.342676:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702503168 00000100:00100000:3.0:1788846258.342682:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702503168 00000100:00100000:3.0:1788846258.342710:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788846258.342717:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:23379:x1875740702503168:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846258.342806:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:23379:x1875740702503168:12345-0@lo:503:mount.lustre.0 Request processed in 89us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846258.342814:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788846258.342911:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503168:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788846258.343296:0:23379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788846258.343375:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846258.343437:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846258.343469:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187300 going to sleep for 11 seconds 00000100:00100000:3.0:1788846258.343860:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702503296 00000100:00100000:3.0:1788846258.343866:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702503296 00000100:00100000:3.0:1788846258.343891:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788846258.343899:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:23379:x1875740702503296:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846258.344003:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:23379:x1875740702503296:12345-0@lo:502:mount.lustre.0 Request processed in 104us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846258.344010:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788846258.344090:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503296:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846258.344252:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788846258.344292:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788846258.344306:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788846258.344318:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788846258.344330:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788846258.344343:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788846258.344355:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788846258.344367:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788846258.344378:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788846258.344404:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788846258.344428:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788846258.344450:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846258.344484:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846258.344512:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187300 going to sleep for 11 seconds 00000100:00100000:3.0:1788846258.345037:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702503424 00000100:00100000:3.0:1788846258.345044:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702503424 00000100:00100000:3.0:1788846258.345069:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788846258.345076:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:23379:x1875740702503424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846258.345174:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:23379:x1875740702503424:12345-0@lo:502:mount.lustre.0 Request processed in 97us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846258.345182:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788846258.345273:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846258.345323:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788846258.345332:0:23379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788846258.346844:0:23392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846258.346858:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846258.346861:0:23392:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788846258.346869:0:23392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e47b586000 00000020:00000080:2.0:1788846258.346871:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788846258.346894:0:23392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846258.346897:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846258.346898:0:23392:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788846258.346900:0:23392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846258.346903:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846258.346904:0:23392:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788846258.346907:0:23392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e47b586000 00000020:00000080:2.0:1788846258.346909:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788846258.346968:0:23392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846258.346972:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846258.346973:0:23392:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788846258.346976:0:23392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846258.346978:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846258.346980:0:23392:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788846258.346984:0:23392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e47b586000 00000020:00000080:2.0:1788846258.346985:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788846258.347001:0:23392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846258.347002:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846258.347003:0:23392:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788846258.347004:0:23392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846258.347006:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846258.347007:0:23392:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788846258.347009:0:23392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e47b586000 00000020:00000080:2.0:1788846258.347010:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788846258.347022:0:23392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846258.347024:0:23392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846258.347025:0:23392:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788846258.347026:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1788846258.347208:0:23379:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788846258.347248:0:23379:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788846258.347267:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.347279:0:23379:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846258.347341:0:23379:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788846258.347345:0:23379:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e47b586000 10000000:01000000:3.0:1788846258.347348:0:23379:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e47b586000 10000000:01000000:3.0:1788846258.347351:0:23379:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788846258.347357:0:23379:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e47b586000 from 1 10000000:01000000:3.0:1788846258.347360:0:23379:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788846258.347391:0:23379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138273532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.347399:0:23379:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138273532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.347419:0:23379:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138273532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846258.347441:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846258.347498:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846258.347556:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e451b300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846258.347780:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702503552 00000100:00100000:0.0:1788846258.347788:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702503552 00000100:00100000:0.0:1788846258.347826:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788846258.347835:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:23379:x1875740702503552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846258.347847:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846258.347858:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0ce00/0x21b4d56138273539 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273532 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.347880:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0ce00/0x21b4d56138273539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273532 expref: 18 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.347891:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0ce00/0x21b4d56138273539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273532 expref: 18 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846258.347899:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0ce00, rc 0) 00000100:00100000:0.0:1788846258.347945:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702503552:12345-0@lo:101:mount.lustre.0 Request processed in 111us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846258.347952:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788846258.348073:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846258.348087:0:23379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138273532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273539 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.348096:0:23379:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138273532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273539 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788846258.354063:0:23379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1788846258.354388:0:23379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846258.354945:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788846258.354975:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1788846258.354989:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1788846258.355002:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1788846258.355014:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1788846258.355027:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1788846258.355039:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1788846258.355052:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1788846258.355065:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788846258.355076:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1788846258.355101:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1788846258.355115:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1788846258.355128:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1788846258.355140:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1788846258.355151:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1788846258.355163:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1788846258.355174:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1788846258.355188:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1788846258.355201:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1788846258.356067:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1788846258.356100:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1788846258.356114:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1788846258.356128:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1788846258.356142:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1788846258.356155:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1788846258.356167:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1788846258.356193:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1788846258.356208:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1788846258.356234:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1788846258.356257:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1788846258.356270:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1788846258.356285:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1788846258.356297:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1788846258.356309:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1788846258.356323:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1788846258.356335:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1788846258.356347:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1788846258.356372:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1788846258.356397:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1788846258.356424:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1788846258.356439:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1788846258.356452:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1788846258.356478:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1788846258.356493:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1788846258.356507:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1788846258.356545:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1788846258.356563:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1788846258.356578:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1788846258.357081:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1788846258.357104:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1788846258.357121:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1788846258.357126:0:23379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1788846258.357279:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846258.357343:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846258.357462:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e451b30480 going to sleep for 11 seconds 00000100:00100000:2.0:1788846258.358263:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702503680 00000100:00100000:2.0:1788846258.358271:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702503680 00000100:00100000:2.0:1788846258.358327:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788846258.358336:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702503680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846258.358487:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702503680:12345-0@lo:501:mount.lustre.0 Request processed in 152us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846258.358500:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846258.358500:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788846258.358557:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846258.358603:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846258.358623:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e451b30480 going to sleep for 11 seconds 00000100:00100000:0.0:1788846258.359436:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702503808 00000100:00100000:0.0:1788846258.359450:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702503808 00000100:00100000:0.0:1788846258.359544:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788846258.359554:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702503808:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846258.359674:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702503808:12345-0@lo:503:mount.lustre.0 Request processed in 123us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846258.359679:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846258.359680:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000040:00080000:3.0:1788846258.360034:0:23379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788846258.360096:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846258.360142:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846258.360294:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e451b300c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846258.360475:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702503936 00000100:00100000:2.0:1788846258.360480:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702503936 00000100:00100000:2.0:1788846258.360544:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788846258.360553:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702503936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846258.360671:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702503936:12345-0@lo:502:mount.lustre.0 Request processed in 119us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846258.360678:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788846258.360722:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702503936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846258.360904:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788846258.360931:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788846258.360947:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788846258.360961:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788846258.360976:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788846258.360992:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788846258.361009:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788846258.361023:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788846258.361040:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788846258.361053:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788846258.361080:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788846258.361096:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788846258.361111:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788846258.361405:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788846258.361444:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788846258.361462:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788846258.361479:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788846258.361498:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788846258.361514:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788846258.361687:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788846258.361705:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788846258.361719:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788846258.361733:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788846258.361746:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788846258.361758:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788846258.361770:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788846258.361797:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788846258.361812:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788846258.361825:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788846258.361838:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788846258.361851:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788846258.361863:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788846258.361875:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788846258.361888:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788846258.361902:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788846258.361915:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788846258.361927:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788846258.361939:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788846258.361952:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788846258.361965:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788846258.361977:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788846258.361990:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788846258.362015:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788846258.362030:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788846258.362043:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788846258.362061:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788846258.362275:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788846258.362298:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788846258.362346:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702504064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846258.362421:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846258.362465:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187780 going to sleep for 11 seconds 00000100:00100000:0.0:1788846258.362468:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702504064 00000100:00100000:0.0:1788846258.362476:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702504064 00000100:00100000:0.0:1788846258.363254:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788846258.363266:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702504064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846258.364947:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702504064:12345-0@lo:502:mount.lustre.0 Request processed in 1676us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846258.364958:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788846258.365306:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702504064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846258.365643:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788846258.365670:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788846258.365706:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702504192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846258.365756:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846258.365783:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187780 going to sleep for 11 seconds 00000100:00100000:0.0:1788846258.368014:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702504192 00000100:00100000:0.0:1788846258.368029:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702504192 00000100:00100000:0.0:1788846258.368094:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788846258.368104:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702504192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846258.378923:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702504192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846258.379217:0:23379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1788846258.379230:0:23379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:0.0:1788846258.382473:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702504192:12345-0@lo:502:mount.lustre.0 Request processed in 14362us (16709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846258.382486:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000020:01000004:2.0:1788846258.385705:0:23397:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788846258.385735:0:23397:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff90e4752eb370) 00000020:00000080:2.0:1788846258.385758:0:23397:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788846258.385847:0:23397:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e47b586000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788846258.385851:0:23397:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e47b586000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788846258.385853:0:23397:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e47b586000 3 00010000:00080000:2.0:1788846258.385892:0:23397:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e4437d0000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1788846258.393669:0:23397:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788846258.393874:0:23397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788846258.394368:0:23397:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788846258.394382:0:23397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x21b4d56138273547 00000100:00080000:2.0:1788846258.394392:0:23397:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788846258.394398:0:23397:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90e4437d0000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846258.394439:0:23397:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e448f85f80 x1875740702504320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846258.394475:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702504320:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846258.394570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846258.394629:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702504320 00000100:00100000:2.0:1788846258.394635:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702504320 00000100:00100000:2.0:1788846258.394667:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788846258.394674:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702504320:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788846258.394706:0:22647:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:2.0:1788846258.394750:0:22647:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x21b4d5613827354e 00000004:00100000:2.0:1788846258.394765:0:22647:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788846258.394802:0:22647:0:(import.c:65:import_set_state_nolock()) ffff90e4464c7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846258.394851:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875740702504320:12345-0@lo:38:llog_process_th.0 Request processed in 175us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846258.394859:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788846258.394894:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90e448f85f80 x1875740702504320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846258.394904:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846258.394911:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788846258.395286:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788846258.395291:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788846258.395293:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e4437d0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788846258.395300:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702504320:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788846258.395323:0:23397:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788846258.395345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846258.395349:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846258.395352:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846258.395355:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788846258.397082:0:23397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1788846258.397800:0:23379:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788846258.397831:0:23379:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788846258.397865:0:23379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138273532 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273539 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.397892:0:23379:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138273532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273539 expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788846258.397940:0:23379:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788846258.397943:0:23379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788846258.397944:0:23379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846258.397945:0:23379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846258.397947:0:23379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846258.397948:0:23379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846258.397949:0:23379:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788846258.397951:0:23379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846258.397952:0:23379:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788846258.397956:0:23379:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788846258.397959:0:23379:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788846258.397960:0:23379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788846258.397961:0:23379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846258.397962:0:23379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846258.397963:0:23379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846258.397964:0:23379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846258.397965:0:23379:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788846258.397966:0:23379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846258.397967:0:23379:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788846258.397990:0:23379:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788846258.398010:0:23379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702504448:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788846258.398073:0:23379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846258.398110:0:23379:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846258.398767:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702504448 00000100:00100000:0.0:1788846258.398775:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702504448 00000100:00100000:0.0:1788846258.398813:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788846258.398821:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702504448:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788846258.398843:0:22642:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788846258.398855:0:22642:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788846258.404341:0:22627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788846258.404384:0:22642:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788846258.404395:0:22642:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788846258.406011:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:23379:x1875740702504448:12345-0@lo:253:mount.lustre.0 Request processed in 7181us (7928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846258.406024:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788846258.406039:0:23379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:23379:1875740702504448:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788846258.406054:0:23379:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788846258.406057:0:23379:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788846258.406059:0:23379:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788846258.406061:0:23379:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846258.406062:0:23379:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846258.406063:0:23379:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846258.406074:0:23379:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846258.406076:0:23379:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788846258.406077:0:23379:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846258.406079:0:23379:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788846258.406092:0:23379:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788846258.413690:0:22663:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788846258.413697:0:22663:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788846258.413718:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.413747:0:22663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342a0c600/0x21b4d56138273459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273452 expref: 17 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.413754:0:22663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e440030200/0x21b4d5613827351d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273516 expref: 17 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.413761:0:22663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.413798:0:22663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e440030200/0x21b4d5613827351d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138273516 expref: 17 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.413811:0:22663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e440030200/0x21b4d5613827351d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138273516 expref: 17 pid: 22640 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846258.413825:0:22663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f85f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702504576:0@lo:104: 00000100:00100000:2.0:1788846258.413887:0:22663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846258.414040:0:22663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342a0c600/0x21b4d56138273459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138273452 expref: 17 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.414048:0:22663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342a0c600/0x21b4d56138273459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138273452 expref: 17 pid: 22641 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846258.414058:0:22663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702504704:0@lo:104: 00000100:00100000:2.0:1788846258.414081:0:22663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788846258.417611:0:23379:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000100:00100000:2.0:1788846258.418592:0:22663:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187b40 going to sleep for 11 seconds 00000020:00080000:0.0:1788846258.418596:0:23403:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788846258.418602:0:23403:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788846258.418805:0:23404:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788846258.418907:0:23379:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788846258.419264:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702504576 00000100:00100000:2.0:1788846258.419265:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702504704 00000100:00100000:3.0:1788846258.419275:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702504576 00000100:00100000:2.0:1788846258.419275:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702504704 00000100:00100000:2.0:1788846258.419324:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788846258.419352:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:22663:x1875740702504704:12345-0@lo:104: 00010000:00010000:2.0:1788846258.419369:0:22630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.419464:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788846258.419471:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:22663:x1875740702504704:12345-0@lo:104: Request processed in 122us (5387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846258.419478:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788846258.419607:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846258.419613:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.419621:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846258.419625:0:22636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.419634:0:22636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846258.419641:0:22636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846258.419646:0:22636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788846258.419693:0:22636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.419701:0:22636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846258.419719:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.419727:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342aaa400/0x21b4d56138273452 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273459 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846258.419743:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846258.419750:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846258.419752:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788846258.419886:0:23379:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788846258.419924:0:23379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788846258.420040:0:23404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788846258.420855:0:23379:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788846258.420867:0:23379:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788846258.420924:0:23379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788846258.421606:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846258.421619:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:22663:x1875740702504576:12345-0@lo:104: 00010000:00010000:3.0:1788846258.421635:0:22631:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.422199:0:22631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846258.422206:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:22663:x1875740702504576:12345-0@lo:104: Request processed in 592us (8318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846258.422214:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788846258.422864:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702504832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846258.423174:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788846258.423180:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846258.423189:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.423199:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846258.423203:0:22635:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.423214:0:22635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846258.423221:0:22635:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846258.423239:0:22635:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788846258.423251:0:22663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f85f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702504576:0@lo:104: 00000100:00100000:2.0:1788846258.423264:0:22663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702504704:0@lo:104: 00010000:00010000:3.0:1788846258.423279:0:22635:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.423287:0:22635:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846258.423308:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.423314:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273516 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827351d expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.423423:0:22663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846258.424633:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702504832 00000100:00100000:2.0:1788846258.424642:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702504832 00010000:00010000:2.0:1788846258.424686:0:22633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342a0c600/0x21b4d56138273459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273452 expref: 18 pid: 22641 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846258.424717:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788846258.424737:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:3643:x1875740702504832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846258.424749:0:22633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846258.424754:0:22633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342a0c600/0x21b4d56138273459 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273452 expref: 18 pid: 22641 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.424765:0:22633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342a0c600/0x21b4d56138273459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138273452 expref: 18 pid: 22641 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.424789:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0c600/0x21b4d56138273459 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138273452 expref: 18 pid: 22641 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.424803:0:22633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846258.424859:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:3643:x1875740702504832:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846258.424866:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788846258.424913:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702504832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846258.426698:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846258.426704:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846258.426706:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846258.426730:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3640:1875740702504960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846258.426797:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846258.426890:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702504960 00000100:00100000:3.0:1788846258.426897:0:22634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702504960 00010000:00010000:3.0:1788846258.426929:0:22634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e440030200/0x21b4d5613827351d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273516 expref: 17 pid: 22640 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846258.426967:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846258.426977:0:22634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:3640:x1875740702504960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846258.426990:0:22634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846258.426996:0:22634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e440030200/0x21b4d5613827351d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273516 expref: 17 pid: 22640 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.427010:0:22634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e440030200/0x21b4d5613827351d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138273516 expref: 17 pid: 22640 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.427038:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e440030200/0x21b4d5613827351d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138273516 expref: 17 pid: 22640 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.427055:0:22634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.427063:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788846258.427077:0:22634:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014338913s 00010000:00010000:3.0:1788846258.427081:0:22634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.427088:0:22634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.427094:0:22634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.427101:0:22634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.427108:0:22634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aabe00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846258.427113:0:22634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.427121:0:22634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.427139:0:22634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846258.427156:0:22634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846258.427201:0:22634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+16:3640:x1875740702504960:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846258.427211:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846258.427261:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3640:1875740702504960:0@lo:103:ldlm_bl.0 00000040:00080000:0.0:1788846258.428364:0:23404:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788846258.428436:0:23404:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00010000:00010000:2.0:1788846258.428464:0:22663:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.428476:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846258.428483:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aabe00/0x21b4d56138273555 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846258.428638:0:23405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23405:1875740702505088:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788846258.428767:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846258.428802:0:23405:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846258.428919:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702505088 00000100:00100000:0.0:1788846258.428925:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702505088 00000100:00100000:0.0:1788846258.428970:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788846258.428978:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23405:x1875740702505088:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788846258.429060:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23405:x1875740702505088:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 83us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846258.429067:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788846258.429137:0:23405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23405:1875740702505088:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788846258.429165:0:23405:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788846258.429189:0:23379:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1788846258.429193:0:23405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cfb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23405:1875740702505216:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788846258.429229:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846258.429249:0:23405:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e451b30900 going to sleep for 11 seconds 00000100:00100000:0.0:1788846258.429287:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702505216 00000100:00100000:0.0:1788846258.429291:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702505216 00000100:00100000:0.0:1788846258.429310:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788846258.429315:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23405:x1875740702505216:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788846258.429646:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23405:x1875740702505216:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 329us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846258.429653:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:00080000:1.0:1788846258.430253:0:23379:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788846258.430297:0:23379:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788846258.433212:0:23379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788846258.434172:0:23405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cfb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23405:1875740702505216:0@lo:1000:lod0001_rec0000.0 00080000:10000000:0.0:1788846258.438154:0:23379:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:1.0:1788846258.439131:0:23405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23405:1875740702505344:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788846258.439205:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846258.439248:0:23405:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b5fd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788846258.439448:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702505344 00000100:00100000:3.0:1788846258.439456:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702505344 00000100:00100000:3.0:1788846258.439504:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788846258.439514:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23405:x1875740702505344:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788846258.439581:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23405:x1875740702505344:12345-0@lo:900:lod0001_rec0000.0 Request processed in 69us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846258.439588:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788846258.439830:0:23405:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90e474541880 x1875740702505344/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788846274 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846258.439846:0:23405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23405:1875740702505344:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788846258.439898:0:23405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23405:1875740702505472:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788846258.439937:0:23405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846258.440033:0:23405:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b5fde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846258.440126:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702505472 00000100:00100000:0.0:1788846258.440131:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702505472 00000100:00100000:0.0:1788846258.440175:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788846258.440182:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23405:x1875740702505472:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788846258.440254:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23405:x1875740702505472:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 73us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846258.440261:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788846258.440455:0:23405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23405:1875740702505472:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788846258.440515:0:23405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:0.0:1788846258.445163:0:23379:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:1.0:1788846258.446347:0:23405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788846258.446564:0:23405:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788846258.446569:0:23405:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1788846258.464879:0:23379:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788846258.464914:0:23379:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb1f0816a7988 00100000:10000000:0.0:1788846258.464923:0:23379:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788846258.465504:0:23379:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788846258.465571:0:23379:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788846258.465596:0:23379:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788846258.465613:0:23379:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788846258.470034:0:23379:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788846258.470285:0:23379:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788846258.489566:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788846259.003143:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788846259.450305:0:23400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788846259.516079:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 10000000:01000000:2.0:1788846259.900414:0:22644:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788846259.900421:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e47b586000 from 12 10000000:01000000:2.0:1788846259.900427:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788846259.900478:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846259.900490:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846259.900551:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846259.900577:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702505600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788846259.900647:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846259.900693:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187900 going to sleep for 11 seconds 00000100:00100000:0.0:1788846259.900736:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702505600 00000100:00100000:0.0:1788846259.900744:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702505600 00000100:00100000:0.0:1788846259.900807:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788846259.900817:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+16:22644:x1875740702505600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846259.900829:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846259.900855:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0c200/0x21b4d56138273563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827355c expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846259.900877:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0c200/0x21b4d56138273563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827355c expref: 17 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846259.900887:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0c200/0x21b4d56138273563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827355c expref: 17 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846259.900895:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0c200, rc 0) 00000100:00100000:0.0:1788846259.900957:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:22644:x1875740702505600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846259.900964:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788846259.900999:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702505600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846259.901014:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846259.901027:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846259.901083:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702505728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788846259.901116:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846259.901140:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788846259.901260:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702505728 00000100:00100000:2.0:1788846259.901265:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702505728 00000100:00100000:2.0:1788846259.901300:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788846259.901311:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:22644:x1875740702505728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788846259.901332:0:22640:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788846259.901348:0:22640:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788846259.901350:0:22640:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788846259.901466:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:22644:x1875740702505728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846259.901473:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788846259.901607:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702505728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788846259.901652:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788846259.901659:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846259.901667:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846259.901675:0:22644:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788846259.901677:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e474598800 from 12 10000000:01000000:0.0:1788846259.901680:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788846259.901696:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846259.901702:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846259.901710:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846259.901722:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702505856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846259.901747:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846259.901778:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342968600 going to sleep for 11 seconds 00000100:00100000:2.0:1788846259.901831:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702505856 00000100:00100000:2.0:1788846259.901836:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702505856 00000100:00100000:2.0:1788846259.901866:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788846259.901873:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:22644:x1875740702505856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846259.901881:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846259.901890:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aaa000/0x21b4d56138273571 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827356a expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846259.901904:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aaa000/0x21b4d56138273571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827356a expref: 18 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846259.901923:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aaa000/0x21b4d56138273571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827356a expref: 18 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846259.901931:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa000, rc 0) 00000100:00100000:2.0:1788846259.901967:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:22644:x1875740702505856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846259.901974:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788846259.902016:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702505856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846259.902028:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846259.902036:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846259.902086:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702505984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788846259.902115:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846259.902137:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846259.902301:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702505984 00000100:00100000:0.0:1788846259.902305:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702505984 00000100:00100000:0.0:1788846259.902346:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788846259.902359:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:22644:x1875740702505984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788846259.902379:0:22641:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788846259.902389:0:22641:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788846259.902393:0:22641:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788846259.902469:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:22644:x1875740702505984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846259.902475:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788846259.902687:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702505984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788846259.902735:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788846259.902742:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846259.902751:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846260.026189:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788846260.474221:0:23400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846260.542807:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788846261.060710:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846261.561581:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788846262.074223:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846262.587628:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788846263.097679:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846263.610614:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 0 seconds 00000100:00100000:3.0:1788846263.611357:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788846263.611392:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702506112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846263.611458:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846263.612170:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788846263.612223:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702506112 00000100:00100000:0.0:1788846263.612231:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702506112 00000100:00100000:0.0:1788846263.612274:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788846263.612282:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702506112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788846263.612312:0:22653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788846263.612362:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702506112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846263.612369:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788846263.612432:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702506112:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788846263.613209:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788846263.613215:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788846263.613219:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e458353800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846263.613227:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90e458353800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846263.613255:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474542d80 x1875740702506368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846263.613271:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846263.613275:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846263.613278:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846263.613281:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846263.613334:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702506368:0@lo:38:kworker.0 00000100:00100000:2.0:1788846263.613400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846263.614162:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702506368 00000100:00100000:0.0:1788846263.614171:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702506368 00000100:00100000:0.0:1788846263.614205:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788846263.614211:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875740702506368:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788846263.614238:0:22653:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:0.0:1788846263.614275:0:22653:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d56138273578 00000004:00100000:0.0:1788846263.614289:0:22653:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788846263.614308:0:22653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788846263.617658:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702506496:0@lo:400:kworker.0 00000100:00100000:3.0:1788846263.617726:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846263.617768:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702506240:0@lo:400:kworker.0 00000100:00100000:3.0:1788846263.617794:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846263.617841:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702506240 00000100:00100000:3.0:1788846263.617847:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702506240 00000100:00100000:3.0:1788846263.617887:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788846263.617895:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:3643:x1875740702506240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846263.617948:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:3643:x1875740702506240:12345-0@lo:400:kworker.0 Request processed in 53us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846263.617958:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788846263.618012:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702506240:0@lo:400:kworker.0 00000100:00100000:2.0:1788846263.618077:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702506496 00000100:00100000:2.0:1788846263.618081:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702506496 00000100:00100000:2.0:1788846263.618121:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788846263.618127:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702506496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846263.618170:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702506496:12345-0@lo:400:kworker.0 Request processed in 43us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846263.618179:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788846263.618992:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846263.618998:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846263.619004:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846263.619007:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788846263.619064:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846263.619075:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702506624:0@lo:400:kworker.0 00000100:00100000:1.0:1788846263.619116:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846263.619145:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702506624 00000100:00100000:1.0:1788846263.619149:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702506624 00000100:00100000:1.0:1788846263.619184:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788846263.619194:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702506624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846263.619237:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702506624:12345-0@lo:400:kworker.0 Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846263.619257:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788846263.619294:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e474541f80 x1875740702506624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846263.619306:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702506624:0@lo:400:kworker.0 00010000:00080000:3.0:1788846263.620585:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e474543480 x1875740702506496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846263.620599:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702506496:0@lo:400:kworker.0 00000100:00080000:3.0:1788846263.637060:0:22653:0:(import.c:65:import_set_state_nolock()) ffff90e47f42a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846263.637156:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875740702506368:12345-0@lo:38:kworker.0 Request processed in 22942us (23752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846263.637166:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788846263.637225:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788846263.637283:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788846263.637290:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788846263.637303:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458353800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788846263.637318:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000dc7cc299): req@ffff90e4745ee680 x1875740702499328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846263.637334:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702506368:0@lo:38:kworker.0 00000100:00100000:3.0:1788846263.637454:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846263.637478:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846263.637493:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702506752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846263.637515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846263.637573:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702499328 00000100:00100000:3.0:1788846263.637579:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702499328 00000100:00100000:3.0:1788846263.637605:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702506752 00000100:00100000:3.0:1788846263.637608:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702506752 00000100:00100000:3.0:1788846263.637620:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788846263.637626:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22689:x1875740702499328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788846263.637689:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22689:x1875740702499328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 63us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846263.637696:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788846263.637710:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788846263.637716:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702506752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788846263.637736:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788846263.637769:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702506752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846263.637774:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788846263.637803:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702506752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846263.637823:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ee680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22689:1875740702499328:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788846263.637865:0:22689:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788846263.637894:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cf100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22689:1875740702506880:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788846263.637922:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846263.637935:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788846263.637946:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702506880 00000100:00100000:3.0:1788846263.637949:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702506880 00000100:00100000:3.0:1788846263.637965:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788846263.637970:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22689:x1875740702506880:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788846263.638054:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22689:x1875740702506880:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846263.638061:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788846263.638085:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cf100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22689:1875740702506880:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788846263.638143:0:22689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cf100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22689:1875740702507008:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788846263.638167:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846263.638179:0:22689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788846263.638190:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702507008 00000100:00100000:3.0:1788846263.638193:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702507008 00000100:00100000:3.0:1788846263.638210:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788846263.638215:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22689:x1875740702507008:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788846263.638263:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22689:x1875740702507008:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 46us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846263.638268:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788846263.638290:0:22689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cf100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22689:1875740702507008:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788846263.638328:0:22689:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846263.640371:0:22689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788846263.653541:0:22689:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:3.0:1788846263.653546:0:22689:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:1.0:1788846263.691718:0:23648:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788846264.129604:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788846264.596873:0:23700:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788846264.597064:0:23700:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788846265.146928:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788846265.622461:0:23750:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788846265.622808:0:23750:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788846266.176744:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788846266.956400:0:23799:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe65227590 20000000:00000080:0.0:1788846266.956418:0:23799:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90e448138400 uarg=0000000000000000 20000000:01000000:0.0:1788846266.956468:0:23799:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788846266.956475:0:23799:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788846266.956480:0:23799:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788846266.957835:0:23800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788846266.957981:0:23799:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788846266.971757:0:23799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788846266.971788:0:23799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846266.971809:0:23799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342aaa600/0x21b4d56138273428 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273421 expref: 17 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846266.971816:0:23799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e440030c00/0x21b4d5613827352b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273524 expref: 17 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846266.971822:0:23799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846266.971862:0:23799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e440030c00/0x21b4d5613827352b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138273524 expref: 17 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846266.971877:0:23799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e440030c00/0x21b4d5613827352b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138273524 expref: 17 pid: 22642 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846266.971891:0:23799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23799:1875740702507136:0@lo:104: 00000100:00100000:0.0:1788846266.971951:0:23799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788846266.972019:0:23799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342aaa600/0x21b4d56138273428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138273421 expref: 17 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846266.972028:0:23799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342aaa600/0x21b4d56138273428 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138273421 expref: 17 pid: 22641 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846266.972038:0:23799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23799:1875740702507264:0@lo:104: 00000100:00100000:0.0:1788846266.972059:0:23799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846266.972950:0:23799:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442b91cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846266.974470:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702507136 00000100:00100000:2.0:1788846266.974485:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702507136 00000100:00100000:2.0:1788846266.974546:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702507264 00000100:00100000:2.0:1788846266.974549:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702507264 00000100:00100000:2.0:1788846266.974567:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788846266.974576:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:23799:x1875740702507136:12345-0@lo:104: 00010000:00010000:2.0:1788846266.974593:0:22630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.974679:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788846266.974686:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:23799:x1875740702507136:12345-0@lo:104: Request processed in 111us (2734us total) trans 0 rc 0/0 00010000:00010000:1.0:1788846266.974694:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846266.974702:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846266.974709:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788846266.974718:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0de00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846266.974723:0:22636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846266.974731:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788846266.974734:0:22636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846266.974740:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+3:23799:x1875740702507264:12345-0@lo:104: 10000000:00010000:1.0:1788846266.974749:0:22636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.974754:0:22630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846266.974758:0:22636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788846266.974801:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788846266.974802:0:22636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846266.974808:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+3:23799:x1875740702507264:12345-0@lo:104: Request processed in 69us (2746us total) trans 0 rc 0/0 00010000:00010000:1.0:1788846266.974814:0:22636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788846266.974820:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788846266.974837:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.974842:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846266.974847:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0de00/0x21b4d56138273524 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827352b expref: -99 pid: 23379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846266.974869:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702507392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846266.974874:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846266.974877:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846266.974879:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846266.974908:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846266.975098:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846266.975104:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.975112:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846266.975115:0:22635:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.975122:0:22635:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846266.975127:0:22635:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846266.975145:0:22635:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788846266.975172:0:22635:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.975178:0:22635:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846266.975190:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.975197:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273421 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273428 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.975211:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846266.975213:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846266.975214:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846266.975222:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788846266.975230:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702507520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846266.975254:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846266.975277:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846266.975279:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846266.975718:0:23799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23799:1875740702507136:0@lo:104: 00000100:00100000:0.0:1788846266.975731:0:23799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23799:1875740702507264:0@lo:104: 00010000:00010000:0.0:1788846266.975753:0:23799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846266.975873:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702507392 00000100:00100000:2.0:1788846266.975879:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702507392 00010000:00010000:2.0:1788846266.975902:0:22633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e440030c00/0x21b4d5613827352b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273524 expref: 18 pid: 22642 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846266.975925:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702507520 00000100:00100000:2.0:1788846266.975928:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702507520 00010000:00010000:2.0:1788846266.975938:0:22633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342aaa600/0x21b4d56138273428 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273421 expref: 19 pid: 22641 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846266.975952:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788846266.975959:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:3642:x1875740702507392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846266.975970:0:22633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846266.975984:0:22633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e440030c00/0x21b4d5613827352b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273524 expref: 19 pid: 22642 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.975994:0:22633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e440030c00/0x21b4d5613827352b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138273524 expref: 19 pid: 22642 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976009:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e440030c00/0x21b4d5613827352b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138273524 expref: 19 pid: 22642 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976023:0:22633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846266.976058:0:22634:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788846266.976067:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:3642:x1875740702507392:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846266.976068:0:22634:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788846266.976077:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788846266.976095:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788846266.976101:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:3642:x1875740702507520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846266.976109:0:22633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846266.976114:0:22633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342aaa600/0x21b4d56138273428 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273421 expref: 17 pid: 22641 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976123:0:22633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342aaa600/0x21b4d56138273428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138273421 expref: 17 pid: 22641 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976134:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aaa600/0x21b4d56138273428 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138273421 expref: 17 pid: 22641 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976147:0:22633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976156:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976193:0:22633:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976201:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976208:0:22633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976214:0:22633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976219:0:22633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846266.976223:0:22633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976230:0:22633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976253:0:22633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846266.976262:0:22633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846266.976287:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+16:3642:x1875740702507520:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846266.976293:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788846266.976668:0:23799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846266.976679:0:23799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846266.976686:0:23799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0d400/0x21b4d5613827357f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846266.980481:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702507520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846266.980514:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702507392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846267.195098:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788846267.642159:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788846268.220199:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788846268.729696:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846268.729703:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846268.729706:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846268.729709:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846268.729732:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846268.729736:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846268.729738:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846268.729740:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788846268.729771:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702508032:0@lo:400:kworker.0 00000100:00100000:1.0:1788846268.729839:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846268.729887:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788846268.729893:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702507904:0@lo:400:kworker.0 00000100:00100000:1.0:1788846268.729919:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846268.729948:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702507904 00000100:00100000:1.0:1788846268.729955:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702507904 00000100:00100000:1.0:1788846268.729999:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788846268.730008:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702507904:12345-0@lo:400:kworker.0 10000000:01000000:3.0:1788846268.730507:0:22644:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788846268.730511:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e47b586000 from 13 10000000:01000000:3.0:1788846268.730516:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788846268.730585:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846268.730595:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846268.730606:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846268.730625:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702508288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788846268.730659:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846268.730686:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846268.730701:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702507776:0@lo:400:kworker.0 00000100:00100000:3.0:1788846268.730726:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846268.730746:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788846268.730752:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702507648:0@lo:400:kworker.0 00000100:00100000:3.0:1788846268.730774:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846268.730790:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702508160:0@lo:400:kworker.0 00000100:00100000:3.0:1788846268.730830:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846268.730857:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702508032 00000100:00100000:3.0:1788846268.730861:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702508032 00000100:00100000:3.0:1788846268.730884:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702507776 00000100:00100000:3.0:1788846268.730887:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702507776 00000100:00100000:3.0:1788846268.730899:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788846268.730905:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702508032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846268.730949:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702508032:12345-0@lo:400:kworker.0 Request processed in 43us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846268.730956:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788846268.730972:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788846268.730977:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702507776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846268.731007:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702507776:12345-0@lo:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846268.731013:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788846268.731639:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702507904:12345-0@lo:400:kworker.0 Request processed in 1630us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846268.731648:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788846268.731663:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702508160 00000100:00100000:1.0:1788846268.731667:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702508160 00000100:00100000:1.0:1788846268.731688:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788846268.731694:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702508160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846268.731729:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702508160:12345-0@lo:400:kworker.0 Request processed in 35us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846268.731735:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788846268.731838:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788846268.731850:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702508416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846268.731886:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846268.731943:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702508416 00000100:00100000:0.0:1788846268.731947:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702508416 00000100:00100000:0.0:1788846268.731973:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788846268.731979:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875740702508416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788846268.732001:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788846268.732040:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875740702508416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846268.732045:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788846268.732100:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702508416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788846268.732898:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702508544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846268.732938:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846268.733027:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702508544 00000100:00100000:1.0:1788846268.733033:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702508544 00000100:00100000:1.0:1788846268.734883:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788846268.734899:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702508544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788846268.734934:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788846268.735005:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702508544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846268.735013:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788846268.735180:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702508544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846268.735483:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846258/real 1788846258] req@ffff90e4745ece00 x1875740702502528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846268 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846268.735502:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e4745ece00 x1875740702502528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846268 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846268.735512:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846258/real 1788846258] req@ffff90e474540000 x1875740702502400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846268 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846268.735540:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e474540000 x1875740702502400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846268 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788846268.735553:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846268.735570:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788846268.735586:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702502528:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788846268.735592:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47f429800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846268.735597:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788846268.735600:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702502400:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788846268.735627:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702508288 00000100:00100000:3.0:1788846268.735633:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702508288 00000100:00100000:3.0:1788846268.735664:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702507648 00000100:00100000:3.0:1788846268.735668:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702507648 00000100:00100000:3.0:1788846268.735681:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788846268.735687:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:22644:x1875740702508288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846268.735698:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846268.735716:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42c600/0x21b4d5613827358d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273586 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846268.735739:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42c600/0x21b4d5613827358d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273586 expref: 18 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846268.735751:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42c600/0x21b4d5613827358d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273586 expref: 18 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846268.735760:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c600, rc 0) 00000100:00100000:3.0:1788846268.735801:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:22644:x1875740702508288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (5141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846268.735808:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788846268.735832:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788846268.735839:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:3641:x1875740702507648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846268.735866:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:3641:x1875740702507648:12345-0@lo:400:kworker.0 Request processed in 28us (5091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846268.735878:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788846268.735925:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702507648:0@lo:400:kworker.0 00010000:00080000:3.0:1788846268.735940:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e474543800 x1875740702508160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846268.735948:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702508160:0@lo:400:kworker.0 00000100:00100000:3.0:1788846268.735959:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702507776:0@lo:400:kworker.0 00000100:00100000:3.0:1788846268.735986:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702508288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846268.736000:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846268.736010:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846268.736095:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702508672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846268.736127:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846268.736154:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846268.736165:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702508672 00000100:00100000:3.0:1788846268.736168:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702508672 00000100:00100000:3.0:1788846268.736189:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788846268.736195:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:22644:x1875740702508672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00080000:1.0:1788846268.736892:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846268.736898:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846268.736911:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846268.736914:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846268.736917:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846268.736921:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788846268.736924:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e47f429800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846268.736929:0:16008:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 642 00000100:00080000:1.0:1788846268.736934:0:16008:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788846268.736940:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90e47f429800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846268.736962:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474542680 x1875740702508800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846268.736982:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846268.736985:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788846268.736986:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846268.736990:0:16008:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 642 00000100:00080000:1.0:1788846268.736992:0:16008:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788846268.736995:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e458351800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846268.737007:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474543800 x1875740702508928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846268.737031:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702508800:0@lo:8:kworker.0 00000400:00000100:1.0:1788846268.737076:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702508800 offset 0 length 520: 4 00000100:00100000:1.0:1788846268.737100:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702508928:0@lo:8:kworker.0 00000400:00000100:1.0:1788846268.737119:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702508928 offset 0 length 520: 4 00010000:00080000:0.0:1788846268.738080:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e474543b80 x1875740702507904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846268.738107:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702507904:0@lo:400:kworker.0 00000100:00100000:0.0:1788846268.738123:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702508032:0@lo:400:kworker.0 00000100:00100000:3.0:1788846268.741043:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:22644:x1875740702508672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4839us (4906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846268.741957:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702508672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788846268.742018:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702509056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788846268.742105:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846268.742150:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442b91cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846268.742471:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702509056 00000100:00100000:2.0:1788846268.742478:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702509056 00000100:00100000:2.0:1788846268.742546:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788846268.742555:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:22644:x1875740702509056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846268.742662:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:22644:x1875740702509056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846268.742669:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788846268.742865:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788846268.743475:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702509056:0@lo:503:ll_cfg_requeue.0 00000001:00100000:1.0:1788846268.745270:0:23380:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1788846268.747614:0:23862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788846268.750378:0:22644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788846268.750421:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788846268.750433:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846268.750445:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846268.750456:0:22644:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788846268.750459:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e474598800 from 13 10000000:01000000:2.0:1788846268.750462:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788846268.750503:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846268.750510:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846268.750562:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846268.750607:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702509184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788846268.750674:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846268.750712:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113300 going to sleep for 11 seconds 00000100:00100000:0.0:1788846268.750821:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702509184 00000100:00100000:0.0:1788846268.750829:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702509184 00000100:00100000:0.0:1788846268.750880:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788846268.750889:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+17:22644:x1875740702509184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846268.750901:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846268.750913:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0c000/0x21b4d5613827359b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273594 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846268.750936:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0c000/0x21b4d5613827359b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273594 expref: 18 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846268.750946:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0c000/0x21b4d5613827359b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273594 expref: 18 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846268.750955:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0c000, rc 0) 00000100:00100000:0.0:1788846268.750993:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:22644:x1875740702509184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846268.751000:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788846268.751156:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702509184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846268.751172:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846268.751181:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846268.751251:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702509312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846268.751402:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846268.751547:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113300 going to sleep for 11 seconds 00000100:00100000:0.0:1788846268.752864:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702509312 00000100:00100000:0.0:1788846268.752890:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702509312 00000100:00100000:1.0:1788846268.753008:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788846268.753018:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:22644:x1875740702509312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846268.753856:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:22644:x1875740702509312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 838us (2451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846268.753865:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788846268.753965:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702509312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846268.754016:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702509440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846268.754143:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846268.754222:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113300 going to sleep for 11 seconds 00000100:00100000:3.0:1788846268.756475:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702509440 00000100:00100000:3.0:1788846268.756488:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702509440 00000100:00100000:3.0:1788846268.756563:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788846268.756573:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:22644:x1875740702509440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846268.756719:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:22644:x1875740702509440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846268.756726:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788846268.757058:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702509440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788846268.769685:0:23863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788846268.770228:0:22644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788846268.770270:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788846268.770282:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846268.770293:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846269.243639:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846270.266663:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846270.714277:0:23400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788846270.786732:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846255/real 1788846255] req@ffff90e448f85500 x1875740702500352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846270 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846270.786766:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e448f85500 x1875740702500352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846270 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846270.786778:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846255/real 1788846255] req@ffff90e448f87100 x1875740702500480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846270 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846270.786789:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e448f87100 x1875740702500480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846270 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788846270.786808:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e474533800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846270.786826:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788846270.786831:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702500352:0@lo:8:kworker.0 00000100:00080000:1.0:1788846270.786836:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343be3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846270.786841:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788846270.786843:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702500480:0@lo:8:kworker.0 00000100:00080000:0.0:1788846270.787016:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846270.787021:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788846270.787024:0:37:0:(import.c:65:import_set_state_nolock()) ffff90e474533800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846270.787028:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 639 00000100:00080000:0.0:1788846270.787033:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788846270.787040:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90e474533800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846270.787060:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745ed180 x1875740702509824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846270.787070:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846270.787073:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788846270.787075:0:37:0:(import.c:65:import_set_state_nolock()) ffff90e343be3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846270.787077:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 639 00000100:00080000:0.0:1788846270.787079:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788846270.787083:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90e343be3000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846270.787092:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745ed880 x1875740702509952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846270.787113:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846270.787116:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788846270.787119:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846270.787122:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788846270.787146:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702509696:0@lo:400:kworker.0 00000100:00100000:0.0:1788846270.787223:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846270.787261:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788846270.787267:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702510080:0@lo:400:kworker.0 00000100:00100000:1.0:1788846270.787503:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702509568:0@lo:400:kworker.0 00000100:00100000:1.0:1788846270.787551:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846270.787582:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702510336:0@lo:400:kworker.0 00000100:00100000:1.0:1788846270.787613:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702509696 00000100:00100000:1.0:1788846270.787620:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702509696 00000100:00100000:1.0:1788846270.787660:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788846270.787667:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702509696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846270.787712:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702509696:12345-0@lo:400:kworker.0 Request processed in 45us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846270.787719:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788846270.787744:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702509824:0@lo:8:kworker.0 00000400:00000100:1.0:1788846270.787764:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702509824 offset 0 length 520: 4 00000100:00100000:1.0:1788846270.787776:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702509952:0@lo:8:kworker.0 00000400:00000100:1.0:1788846270.787790:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702509952 offset 0 length 520: 4 00000100:00100000:3.0:1788846270.787905:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702509568 00000100:00100000:3.0:1788846270.787918:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702509568 00000100:00100000:3.0:1788846270.787946:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788846270.787953:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:3643:x1875740702509568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846270.787992:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:3643:x1875740702509568:12345-0@lo:400:kworker.0 Request processed in 39us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846270.787999:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788846270.788052:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702510208:0@lo:400:kworker.0 00000100:00100000:3.0:1788846270.788077:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846270.788436:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846270.788484:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702509696:0@lo:400:kworker.0 00000100:00100000:1.0:1788846270.788647:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702510208 00000100:00100000:1.0:1788846270.788652:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702510208 00000100:00100000:1.0:1788846270.788686:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788846270.788693:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702510208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846270.788733:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702510208:12345-0@lo:400:kworker.0 Request processed in 40us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846270.788739:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788846270.788807:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702510080 00000100:00100000:3.0:1788846270.788812:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702510080 00000100:00100000:3.0:1788846270.788864:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788846270.788871:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702510080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846270.788919:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702510080:12345-0@lo:400:kworker.0 Request processed in 40us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846270.788926:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788846270.788952:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702510208:0@lo:400:kworker.0 00010000:00080000:3.0:1788846270.788983:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e4745ef480 x1875740702510080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846270.789008:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702510080:0@lo:400:kworker.0 00000100:00100000:3.0:1788846270.789026:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846270.789057:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702509568:0@lo:400:kworker.0 00000100:00100000:3.0:1788846270.789075:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702510336 00000100:00100000:3.0:1788846270.789078:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702510336 00000100:00100000:3.0:1788846270.789097:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788846270.789102:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702510336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846270.789135:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702510336:12345-0@lo:400:kworker.0 Request processed in 32us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846270.789140:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788846270.789164:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e4745ec380 x1875740702510336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846270.789174:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702510336:0@lo:400:kworker.0 00010000:00010000:3.0:1788846271.290805:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846272.319768:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846273.338682:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846273.850766:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846273.850784:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702510464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788846273.850847:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846273.850891:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702510464 00000100:00100000:1.0:1788846273.850899:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702510464 00000100:00100000:1.0:1788846273.850949:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788846273.850971:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702510464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788846273.851005:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788846273.851048:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702510464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846273.851055:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788846273.851098:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702510464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846273.876663:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788846273.876683:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702510592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846273.876760:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846273.876814:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702510592 00000100:00100000:3.0:1788846273.876822:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702510592 00000100:00100000:3.0:1788846273.876864:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788846273.876872:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702510592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788846273.876904:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788846273.876944:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702510592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846273.876965:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788846273.877009:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702510592:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788846274.364417:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788846274.836858:0:24149:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788846274.836862:0:24149:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788846274.836863:0:24149:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788846274.836967:0:24149:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90e34377d800 00000020:01000004:1.0:1788846274.836982:0:24149:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788846274.836995:0:24149:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788846274.837009:0:24149:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90e46d51cd28) 00000020:00000080:1.0:1788846274.837023:0:24149:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788846274.886087:0:24149:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788846274.888321:0:24149:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788846274.888969:0:24149:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788846274.889162:0:24149:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788846274.891517:0:24149:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788846274.891881:0:24149:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788846274.892090:0:24149:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788846274.897194:0:24149:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788846274.897603:0:24149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788846274.897616:0:24149:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788846274.897627:0:24149:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x21b4d561382735a9 00000020:01000004:2.0:1788846274.897633:0:24149:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788846274.897653:0:24149:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788846274.897656:0:24149:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788846274.897662:0:24149:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788846274.897667:0:24149:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788846274.897678:0:24149:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90e4752e99b8) 00000020:00000080:2.0:1788846274.897689:0:24149:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788846274.902150:0:24149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788846274.905747:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788846274.905754:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788846274.906747:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788846274.906755:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788846274.910478:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788846274.910491:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788846274.913039:0:24149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788846274.913224:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788846274.913230:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788846274.915059:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788846274.915068:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788846274.950123:0:24149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788846274.952899:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788846274.952913:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788846274.957709:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788846274.957790:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788846274.958938:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788846274.960925:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788846274.966627:0:24149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846274.966824:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788846274.966830:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788846274.967878:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788846274.967886:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788846275.016332:0:24149:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788846275.016557:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788846275.016563:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788846275.018682:0:24149:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788846275.018694:0:24149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788846275.019061:0:24149:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788846275.019087:0:24149:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788846275.019093:0:24149:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788846275.031851:0:24149:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788846275.031888:0:24149:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788846275.031892:0:24149:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788846275.031894:0:24149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788846275.031895:0:24149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846275.031897:0:24149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846275.031898:0:24149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846275.031900:0:24149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846275.031901:0:24149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788846275.031903:0:24149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846275.031904:0:24149:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788846275.031908:0:24149:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788846275.031910:0:24149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788846275.031911:0:24149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788846275.031912:0:24149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846275.031913:0:24149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846275.031914:0:24149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846275.031915:0:24149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846275.031920:0:24149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788846275.031921:0:24149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846275.031922:0:24149:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788846275.031946:0:24149:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788846275.031962:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702510720:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788846275.032029:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.032100:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846275.032136:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702510720 00000100:00100000:0.0:1788846275.032144:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702510720 00000100:00100000:0.0:1788846275.032223:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788846275.032232:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:24149:x1875740702510720:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788846275.032274:0:22641:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788846275.032277:0:22641:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788846275.032281:0:22641:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788846275.032615:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:24149:x1875740702510720:12345-0@lo:253:mount.lustre.0 Request processed in 383us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846275.032623:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788846275.032700:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702510720:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788846275.032708:0:24149:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788846275.032710:0:24149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788846275.032711:0:24149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788846275.032712:0:24149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846275.032713:0:24149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846275.032713:0:24149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846275.032714:0:24149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846275.032715:0:24149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788846275.032716:0:24149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846275.032717:0:24149:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788846275.032733:0:24149:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e34377d800 from lustre-OST0000 10000000:01000000:1.0:1788846275.032755:0:24149:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788846275.032758:0:24149:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788846275.032764:0:24149:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90e449bd99b8 local copy 00010000:00010000:1.0:1788846275.032772:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846275.032851:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702510848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846275.032877:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.033433:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113180 going to sleep for 11 seconds 00000100:00100000:3.0:1788846275.033593:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702510848 00000100:00100000:3.0:1788846275.033599:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702510848 00000100:00100000:3.0:1788846275.033626:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788846275.033633:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:24149:x1875740702510848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846275.033707:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:24149:x1875740702510848:12345-0@lo:501:mount.lustre.0 Request processed in 74us (828us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788846275.033714:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788846275.033806:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702510848:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788846275.033819:0:24149:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788846275.033837:0:24149:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788846275.033850:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.033859:0:24149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846275.033887:0:24149:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e34377d800 10000000:01000000:1.0:1788846275.033891:0:24149:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788846275.033896:0:24149:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788846275.033898:0:24149:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788846275.033902:0:24149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788846275.033905:0:24149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788846275.033924:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d561382735b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.033932:0:24149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d561382735b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.033941:0:24149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d561382735b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846275.033955:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702510976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788846275.033982:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.033998:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113180 going to sleep for 11 seconds 00000100:00100000:3.0:1788846275.034046:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702510976 00000100:00100000:3.0:1788846275.034051:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702510976 00000100:00100000:3.0:1788846275.034068:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788846275.034074:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+18:24149:x1875740702510976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846275.034082:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846275.034100:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42d400/0x21b4d561382735be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382735b7 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846275.034119:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42d400/0x21b4d561382735be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382735b7 expref: 19 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846275.034130:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42d400/0x21b4d561382735be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382735b7 expref: 19 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846275.034139:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d400, rc 0) 00000100:00100000:3.0:1788846275.034175:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:24149:x1875740702510976:12345-0@lo:101:mount.lustre.0 Request processed in 100us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846275.034181:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788846275.034361:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702510976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846275.034374:0:24149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d561382735b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382735be expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.034384:0:24149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d561382735b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382735be expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788846275.035400:0:24149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788846275.035996:0:24149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788846275.044712:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788846275.044764:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788846275.044778:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788846275.044791:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788846275.044804:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788846275.044815:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788846275.044827:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788846275.044837:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788846275.044850:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788846275.044862:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788846275.044876:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788846275.044889:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788846275.044911:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788846275.044916:0:24149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788846275.045012:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846275.045070:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.045114:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702511104 00000100:00100000:1.0:1788846275.045119:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702511104 00000100:00100000:1.0:1788846275.045160:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788846275.045169:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:24149:x1875740702511104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846275.045817:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:24149:x1875740702511104:12345-0@lo:501:mount.lustre.0 Request processed in 646us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846275.045825:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788846275.045867:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113480 going to sleep for 11 seconds 00000100:00100000:1.0:1788846275.045887:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846275.045933:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846275.045968:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.045989:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702511232 00000100:00100000:1.0:1788846275.045993:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702511232 00000100:00100000:1.0:1788846275.046011:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788846275.046017:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:24149:x1875740702511232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846275.046611:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113480 going to sleep for 11 seconds 00000100:00100000:1.0:1788846275.047181:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:24149:x1875740702511232:12345-0@lo:503:mount.lustre.0 Request processed in 1161us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846275.047189:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788846275.048095:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511232:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788846275.050003:0:24149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788846275.050092:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474540700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846275.050164:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.050235:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113180 going to sleep for 11 seconds 00000100:00100000:0.0:1788846275.051834:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702511360 00000100:00100000:0.0:1788846275.051858:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702511360 00000100:00100000:1.0:1788846275.052024:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788846275.052033:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:24149:x1875740702511360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846275.052880:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:24149:x1875740702511360:12345-0@lo:502:mount.lustre.0 Request processed in 847us (2713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846275.052888:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788846275.052992:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474540700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846275.053219:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788846275.053247:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788846275.053262:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788846275.053290:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788846275.053316:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788846275.053334:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788846275.053361:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788846275.053374:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788846275.053388:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788846275.053401:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788846275.053414:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788846275.053427:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788846275.053472:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846275.053516:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846275.054252:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788846275.054377:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702511488 00000100:00100000:2.0:1788846275.054385:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702511488 00000100:00100000:2.0:1788846275.054421:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788846275.054429:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:24149:x1875740702511488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846275.054577:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:24149:x1875740702511488:12345-0@lo:502:mount.lustre.0 Request processed in 148us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846275.054584:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788846275.055775:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846275.055862:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788846275.055875:0:24149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788846275.058794:0:24166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788846275.058805:0:24166:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788846275.058812:0:24166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.058814:0:24166:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788846275.058820:0:24166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788846275.058834:0:24166:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90e3438799b8) 00000020:00000080:3.0:1788846275.058857:0:24166:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788846275.058863:0:24166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788846275.058939:0:24166:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e34377d800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788846275.058947:0:24166:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788846275.058954:0:24166:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x21b4d561382735cc 00010000:00010000:3.0:1788846275.062001:0:24166:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788846275.071815:0:24166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1788846275.074003:0:24166:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788846275.075420:0:24166:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788846275.075429:0:24166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846275.075435:0:24166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.075437:0:24166:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788846275.075441:0:24166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788846275.075443:0:24166:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788846275.075455:0:24166:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788846275.075457:0:24166:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788846275.075458:0:24166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788846275.075461:0:24166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.075462:0:24166:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788846275.075465:0:24166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846275.075468:0:24166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.075469:0:24166:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788846275.075472:0:24166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788846275.075474:0:24166:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788846275.075482:0:24166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846275.075485:0:24166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.075486:0:24166:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788846275.075488:0:24166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846275.075491:0:24166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.075492:0:24166:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788846275.075496:0:24166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788846275.075536:0:24166:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846275.075540:0:24166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.075541:0:24166:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788846275.075544:0:24166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788846275.075825:0:24149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788846275.075857:0:24149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788846275.075877:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d561382735b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382735be expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.075889:0:24149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d561382735b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382735be expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846275.075898:0:24149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e34377d800 from 1 10000000:01000000:2.0:1788846275.075900:0:24149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788846275.075933:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.075940:0:24149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.075951:0:24149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846275.075973:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846275.076033:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846275.076075:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e441420240 going to sleep for 11 seconds 00000100:00100000:0.0:1788846275.076145:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702511616 00000100:00100000:0.0:1788846275.076151:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702511616 00000100:00100000:0.0:1788846275.076193:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788846275.076201:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:24149:x1875740702511616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846275.076213:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846275.076224:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0ca00/0x21b4d561382735da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382735d3 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846275.076245:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0ca00/0x21b4d561382735da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382735d3 expref: 20 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846275.076254:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0ca00/0x21b4d561382735da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382735d3 expref: 20 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846275.076262:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0ca00, rc 0) 00000100:00100000:0.0:1788846275.076308:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:24149:x1875740702511616:12345-0@lo:101:mount.lustre.0 Request processed in 95us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846275.076315:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788846275.076614:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846275.076627:0:24149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.076636:0:24149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846275.079403:0:24149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788846275.079933:0:24149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846275.080105:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788846275.080126:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788846275.080137:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788846275.080147:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788846275.080158:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788846275.080168:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788846275.080178:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788846275.080188:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788846275.080198:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788846275.080208:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788846275.085337:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788846275.085384:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788846275.085390:0:24149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788846275.085582:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511744:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846275.085760:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846275.085800:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4484df000 going to sleep for 11 seconds 00000100:00100000:1.0:1788846275.086355:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702511744 00000100:00100000:1.0:1788846275.086364:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702511744 00000100:00100000:1.0:1788846275.086414:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788846275.086423:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:24149:x1875740702511744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846275.087557:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:24149:x1875740702511744:12345-0@lo:501:mount.lustre.0 Request processed in 1131us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846275.087566:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788846275.088495:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846275.088569:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846275.088790:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846275.088830:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e445172cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846275.088891:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702511872 00000100:00100000:3.0:1788846275.088898:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702511872 00000100:00100000:3.0:1788846275.088938:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788846275.088947:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:24149:x1875740702511872:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846275.089050:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:24149:x1875740702511872:12345-0@lo:503:mount.lustre.0 Request processed in 104us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846275.089057:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788846275.089379:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702511872:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788846275.090025:0:24149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788846275.090105:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846275.090141:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846275.090172:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420480 going to sleep for 11 seconds 00000100:00100000:3.0:1788846275.090229:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702512000 00000100:00100000:3.0:1788846275.090234:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702512000 00000100:00100000:3.0:1788846275.090272:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788846275.090280:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:24149:x1875740702512000:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846275.090365:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:24149:x1875740702512000:12345-0@lo:502:mount.lustre.0 Request processed in 85us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846275.090378:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788846275.090571:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846275.090750:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788846275.090773:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788846275.090785:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788846275.090796:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788846275.090807:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788846275.090819:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788846275.090844:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788846275.090856:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788846275.090867:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788846275.090878:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788846275.090897:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788846275.090916:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846275.090949:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846275.090969:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4500cd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846275.091100:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702512128 00000100:00100000:2.0:1788846275.091104:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702512128 00000100:00100000:2.0:1788846275.091134:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788846275.091141:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:24149:x1875740702512128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846275.091208:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:24149:x1875740702512128:12345-0@lo:502:mount.lustre.0 Request processed in 67us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846275.091214:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788846275.091589:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846275.091642:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788846275.091651:0:24149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788846275.092307:0:24170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846275.092318:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.092320:0:24170:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788846275.092326:0:24170:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e34377d800 00000020:00000080:3.0:1788846275.092328:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846275.092336:0:24170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846275.092338:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.092339:0:24170:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788846275.092341:0:24170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846275.092343:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.092344:0:24170:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788846275.092347:0:24170:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e34377d800 00000020:00000080:3.0:1788846275.092349:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846275.093423:0:24170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846275.093430:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.093432:0:24170:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788846275.093435:0:24170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846275.093438:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846275.093439:0:24170:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788846275.093442:0:24170:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e34377d800 00000020:00000080:3.0:1788846275.093455:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846275.095322:0:24170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846275.095432:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846275.095435:0:24170:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788846275.095441:0:24170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846275.095453:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846275.095455:0:24170:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788846275.095461:0:24170:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e34377d800 00000020:00000080:2.0:1788846275.095463:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788846275.095540:0:24170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846275.095543:0:24170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846275.095545:0:24170:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788846275.095548:0:24170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788846275.098113:0:24149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788846275.098167:0:24149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788846275.098220:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846275.098233:0:24149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846275.098291:0:24149:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788846275.098307:0:24149:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e34377d800 10000000:01000000:0.0:1788846275.098310:0:24149:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e34377d800 10000000:01000000:0.0:1788846275.098314:0:24149:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788846275.098320:0:24149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e34377d800 from 1 10000000:01000000:0.0:1788846275.098324:0:24149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788846275.098358:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d561382735e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846275.098367:0:24149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d561382735e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846275.098378:0:24149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d561382735e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846275.098417:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788846275.098476:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846275.098514:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4500cd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846275.102736:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702512256 00000100:00100000:2.0:1788846275.102751:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702512256 00000100:00100000:2.0:1788846275.102810:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788846275.102820:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:24149:x1875740702512256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846275.102835:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846275.102851:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aaba00/0x21b4d561382735e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382735e1 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.102879:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aaba00/0x21b4d561382735e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382735e1 expref: 21 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.102890:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aaba00/0x21b4d561382735e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382735e1 expref: 21 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.102908:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaba00, rc 0) 00000100:00100000:2.0:1788846275.102992:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702512256:12345-0@lo:101:mount.lustre.0 Request processed in 173us (4515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846275.102999:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788846275.103020:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846275.103042:0:24149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d561382735e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382735e8 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846275.103103:0:24149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d561382735e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382735e8 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846275.106172:0:24149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788846275.106490:0:24149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846275.106983:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788846275.107007:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788846275.107023:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788846275.107035:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788846275.107048:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788846275.107061:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788846275.107073:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788846275.107086:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788846275.107099:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788846275.107111:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788846275.107140:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788846275.107155:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788846275.107168:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788846275.107184:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788846275.107203:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788846275.107230:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788846275.107242:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788846275.107251:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788846275.107365:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788846275.107383:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788846275.107394:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788846275.107404:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788846275.107417:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788846275.107429:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788846275.107575:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788846275.107596:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788846275.107625:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788846275.107640:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788846275.107657:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788846275.107676:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788846275.107690:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788846275.107705:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788846275.107718:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788846275.107731:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788846275.107744:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788846275.107756:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788846275.107768:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788846275.108375:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788846275.108407:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788846275.108420:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788846275.108432:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788846275.108445:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788846275.108471:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788846275.108486:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788846275.108500:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788846275.108514:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788846275.108574:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788846275.108589:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788846275.108721:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788846275.108742:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788846275.108759:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788846275.108764:0:24149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788846275.108859:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846275.108922:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846275.108965:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846275.109030:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702512384 00000100:00100000:0.0:1788846275.109038:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702512384 00000100:00100000:0.0:1788846275.109100:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788846275.109110:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702512384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846275.111055:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702512384:12345-0@lo:501:mount.lustre.0 Request processed in 1931us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846275.111067:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788846275.111314:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846275.111363:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846275.111410:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846275.111436:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788846275.111453:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702512512 00000100:00100000:3.0:1788846275.111458:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702512512 00000100:00100000:3.0:1788846275.111491:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788846275.111506:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702512512:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846275.111620:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702512512:12345-0@lo:503:mount.lustre.0 Request processed in 115us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846275.111626:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788846275.112354:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512512:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788846275.113332:0:24149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788846275.113424:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846275.113477:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846275.113510:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4500cd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846275.113548:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702512640 00000100:00100000:0.0:1788846275.113554:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702512640 00000100:00100000:0.0:1788846275.113591:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788846275.114154:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702512640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846275.114268:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702512640:12345-0@lo:502:mount.lustre.0 Request processed in 116us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846275.114275:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788846275.119565:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846275.119831:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788846275.119860:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788846275.119874:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788846275.119887:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788846275.119901:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788846275.119914:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788846275.119932:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788846275.119961:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788846275.119975:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788846275.119987:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788846275.120000:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788846275.120013:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788846275.120027:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788846275.120039:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788846275.120053:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788846275.120066:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788846275.120079:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788846275.120092:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788846275.120104:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788846275.120117:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788846275.120130:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788846275.120143:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788846275.120156:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788846275.120185:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788846275.120204:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788846275.125780:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788846275.125812:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788846275.125829:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788846275.125845:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788846275.125861:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788846275.125891:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788846275.125907:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788846275.125921:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788846275.125936:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788846275.125951:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788846275.125964:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788846275.125976:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788846275.125987:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788846275.126001:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788846275.126013:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788846275.126028:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788846275.126042:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788846275.126056:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788846275.126071:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788846275.126084:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788846275.126097:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788846275.126119:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788846275.126130:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788846275.126181:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846275.126254:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846275.126311:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4500cd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788846275.126803:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702512768 00000100:00100000:3.0:1788846275.126811:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702512768 00000100:00100000:3.0:1788846275.126856:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788846275.126865:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702512768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846275.126984:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702512768:12345-0@lo:502:mount.lustre.0 Request processed in 119us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846275.126991:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788846275.127466:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846275.127743:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788846275.127766:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788846275.127794:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846275.127840:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.127863:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e34352dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846275.128697:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702512896 00000100:00100000:0.0:1788846275.128706:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702512896 00000100:00100000:0.0:1788846275.128754:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788846275.128762:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702512896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846275.128878:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702512896:12345-0@lo:502:mount.lustre.0 Request processed in 116us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846275.128885:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788846275.137394:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702512896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846275.137486:0:24149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788846275.137500:0:24149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788846275.139048:0:24175:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788846275.139063:0:24175:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90e450c6cd28) 00000020:00000080:0.0:1788846275.139086:0:24175:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788846275.139176:0:24175:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e34377d800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788846275.139181:0:24175:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e34377d800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788846275.139183:0:24175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e34377d800 3 00010000:00080000:0.0:1788846275.139213:0:24175:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e343778000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788846275.140813:0:24175:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788846275.140996:0:24175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788846275.141034:0:24175:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788846275.141045:0:24175:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x21b4d561382735f6 00000100:00080000:0.0:1788846275.141053:0:24175:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846275.141058:0:24175:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90e343778000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846275.141087:0:24175:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4745ed500 x1875740702513024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846275.141134:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702513024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788846275.141195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788846275.141241:0:24175:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788846275.141353:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846275.141358:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846275.141360:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846275.141363:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846275.141390:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846275.141394:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846275.141396:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846275.141399:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788846275.141423:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702513152:0@lo:400:kworker.0 00000100:00100000:1.0:1788846275.141453:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.141474:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846275.141479:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702513280:0@lo:400:kworker.0 00000100:00100000:1.0:1788846275.141500:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.141552:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702513408:0@lo:400:kworker.0 00000100:00100000:1.0:1788846275.141574:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.141589:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788846275.141593:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702513536:0@lo:400:kworker.0 00000100:00100000:1.0:1788846275.141612:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.141647:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702513152 00000100:00100000:1.0:1788846275.141653:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702513152 00000100:00100000:1.0:1788846275.141679:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702513408 00000100:00100000:1.0:1788846275.141682:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702513408 00000100:00100000:1.0:1788846275.141695:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788846275.141703:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702513152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846275.141752:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702513152:12345-0@lo:400:kworker.0 Request processed in 49us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846275.141758:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788846275.141773:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788846275.141779:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702513408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846275.141808:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702513408:12345-0@lo:400:kworker.0 Request processed in 30us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846275.141814:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788846275.141832:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702513024 00000100:00100000:1.0:1788846275.141835:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702513024 00000100:00100000:1.0:1788846275.141844:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702513280 00000100:00100000:1.0:1788846275.141847:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702513280 00000100:00100000:1.0:1788846275.141859:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702513536 00000100:00100000:1.0:1788846275.141861:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702513536 00000100:00100000:1.0:1788846275.141874:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788846275.141880:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702513280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846275.141908:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702513280:12345-0@lo:400:kworker.0 Request processed in 29us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846275.141915:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788846275.141926:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788846275.141931:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702513536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846275.141957:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702513536:12345-0@lo:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846275.141969:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788846275.141981:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788846275.141985:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702513024:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788846275.142002:0:22648:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:1.0:1788846275.142039:0:22648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x21b4d561382735fd 00000004:00100000:1.0:1788846275.142054:0:22648:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788846275.142083:0:22648:0:(import.c:65:import_set_state_nolock()) ffff90e342a27800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846275.142121:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875740702513024:12345-0@lo:38:llog_process_th.0 Request processed in 134us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846275.142127:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788846275.142169:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e4745ed500 x1875740702513024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846275.142180:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788846275.142187:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788846275.142194:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788846275.142198:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788846275.142200:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343778000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788846275.142206:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702513024:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788846275.142235:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e474541880 x1875740702513536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846275.142244:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702513536:0@lo:400:kworker.0 00000100:00100000:1.0:1788846275.142255:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702513408:0@lo:400:kworker.0 00010000:00080000:1.0:1788846275.142278:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e474542d80 x1875740702513280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846275.142293:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702513280:0@lo:400:kworker.0 00000100:00100000:1.0:1788846275.142318:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702513152:0@lo:400:kworker.0 00000020:01000004:1.0:1788846275.146558:0:24175:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788846275.146575:0:24175:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90e46d51b370) 00000020:00000080:1.0:1788846275.148087:0:24175:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788846275.149678:0:24175:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e34377d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788846275.149686:0:24175:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e34377d800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788846275.149689:0:24175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e34377d800 3 00010000:00080000:1.0:1788846275.149734:0:24175:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e342a23000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1788846275.152443:0:24175:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788846275.153438:0:24175:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788846275.153480:0:24175:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788846275.153493:0:24175:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x21b4d5613827360b 00000100:00080000:1.0:1788846275.153502:0:24175:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788846275.153508:0:24175:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90e342a23000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846275.153565:0:24175:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474541f80 x1875740702513664/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846275.153588:0:24175:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788846275.153611:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846275.153615:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846275.153618:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846275.153621:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846275.153624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846275.153627:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846275.153637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846275.153639:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846275.154102:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875740702513664:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846275.154172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.156717:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702513664 00000100:00100000:1.0:1788846275.156729:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702513664 00000100:00100000:1.0:1788846275.156766:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788846275.156774:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702513664:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788846275.156802:0:22648:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:1.0:1788846275.156848:0:22648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x21b4d56138273612 00000004:00100000:1.0:1788846275.156864:0:22648:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788846275.156896:0:22648:0:(import.c:65:import_set_state_nolock()) ffff90e342a25000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846275.156979:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875740702513664:12345-0@lo:38:llog_process_th.0 Request processed in 203us (2805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846275.156986:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788846275.157030:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e474541f80 x1875740702513664/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846275.157042:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788846275.157049:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788846275.157057:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788846275.157061:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788846275.157063:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e342a23000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788846275.157068:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875740702513664:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788846275.157172:0:24175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788846275.157266:0:24149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788846275.157306:0:24149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788846275.157326:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d561382735e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382735e8 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.157343:0:24149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d561382735e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382735e8 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788846275.157390:0:24149:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788846275.157392:0:24149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788846275.157393:0:24149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846275.157394:0:24149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846275.157396:0:24149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846275.157397:0:24149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846275.157398:0:24149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788846275.157400:0:24149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846275.157402:0:24149:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788846275.157406:0:24149:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788846275.157408:0:24149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788846275.157410:0:24149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788846275.157411:0:24149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846275.157412:0:24149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846275.157413:0:24149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846275.157414:0:24149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846275.157415:0:24149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788846275.157416:0:24149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846275.157417:0:24149:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788846275.157434:0:24149:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788846275.157449:0:24149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702513792:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788846275.157486:0:24149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846275.157509:0:24149:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e34352d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788846275.157635:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702513792 00000100:00100000:0.0:1788846275.157640:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702513792 00000100:00100000:0.0:1788846275.157674:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788846275.157688:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702513792:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788846275.157708:0:22640:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788846275.157720:0:22640:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788846275.167446:0:22640:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788846275.167461:0:22640:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788846275.167567:0:22663:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788846275.167572:0:22663:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788846275.167593:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.167624:0:22663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342a0c200/0x21b4d56138273563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827355c expref: 21 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.167632:0:22663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342aaa000/0x21b4d56138273571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827356a expref: 21 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.167641:0:22663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.167676:0:22663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342aaa000/0x21b4d56138273571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827356a expref: 21 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.167691:0:22663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342aaa000/0x21b4d56138273571 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827356a expref: 21 pid: 22642 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846275.167705:0:22663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702513920:0@lo:104: 00000100:00100000:2.0:1788846275.167768:0:22663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846275.167815:0:22663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342a0c200/0x21b4d56138273563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827355c expref: 21 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.167823:0:22663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342a0c200/0x21b4d56138273563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827355c expref: 21 pid: 22641 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846275.167843:0:22663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f85500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702514048:0@lo:104: 00000100:00100000:2.0:1788846275.167868:0:22663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846275.167882:0:22663:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e444c2ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788846275.168971:0:22631:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788846275.168992:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702513920 00000100:00100000:3.0:1788846275.168999:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702513920 00000100:00100000:3.0:1788846275.169031:0:22631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702514048 00000100:00100000:3.0:1788846275.169034:0:22631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702514048 00000100:00100000:3.0:1788846275.169047:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788846275.169054:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:22663:x1875740702513920:12345-0@lo:104: 00010000:00010000:3.0:1788846275.169066:0:22631:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846275.169134:0:22631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846275.169140:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:22663:x1875740702513920:12345-0@lo:104: Request processed in 86us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846275.169146:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788846275.169162:0:22631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788846275.169168:0:22631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d6c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+3:22663:x1875740702514048:12345-0@lo:104: 00010000:00010000:3.0:1788846275.169188:0:22631:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846275.169261:0:22631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788846275.169275:0:22631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d6c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+3:22663:x1875740702514048:12345-0@lo:104: Request processed in 99us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846275.169281:0:22631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846275.169453:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24149:x1875740702513792:12345-0@lo:253:mount.lustre.0 Request processed in 11766us (11965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846275.169462:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788846275.169506:0:22663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702513920:0@lo:104: 00000100:00100000:2.0:1788846275.169515:0:22663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f85500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702514048:0@lo:104: 00010000:00010000:2.0:1788846275.169548:0:22663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.170047:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788846275.170055:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.170063:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0cc00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846275.170067:0:22636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.170086:0:22636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846275.170094:0:22636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846275.170099:0:22636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788846275.170137:0:22636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.170144:0:22636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846275.170167:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.170174:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d5613827356a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273571 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.170186:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846275.170189:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.170195:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846275.170198:0:22636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.170203:0:22636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846275.170209:0:22636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846275.170220:0:22636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788846275.170233:0:22636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.170239:0:22636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846275.170245:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.170251:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342aaa800/0x21b4d5613827355c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273563 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846275.170352:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702514176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846275.170386:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846275.170415:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788846275.170420:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702514304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846275.170438:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846275.170461:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702514176 00000100:00100000:2.0:1788846275.170465:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702514176 00010000:00010000:2.0:1788846275.170482:0:22632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342aaa000/0x21b4d56138273571 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827356a expref: 21 pid: 22642 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846275.170497:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702514304 00000100:00100000:2.0:1788846275.170500:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702514304 00010000:00010000:2.0:1788846275.170507:0:22632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342a0c200/0x21b4d56138273563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827355c expref: 22 pid: 22641 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846275.170539:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788846275.170551:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:3642:x1875740702514176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846275.170560:0:22632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846275.170565:0:22632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342aaa000/0x21b4d56138273571 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827356a expref: 22 pid: 22642 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.170575:0:22632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342aaa000/0x21b4d56138273571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827356a expref: 22 pid: 22642 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.170587:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aaa000/0x21b4d56138273571 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827356a expref: 22 pid: 22642 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846275.170818:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846275.172860:0:22632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846275.172921:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:3642:x1875740702514176:12345-0@lo:103:ldlm_bl.0 Request processed in 2368us (2531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846275.172932:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788846275.172955:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846275.172962:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:3642:x1875740702514304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846275.172973:0:22632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846275.172979:0:22632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342a0c200/0x21b4d56138273563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827355c expref: 20 pid: 22641 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.172990:0:22632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342a0c200/0x21b4d56138273563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827355c expref: 20 pid: 22641 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173005:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0c200/0x21b4d56138273563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827355c expref: 20 pid: 22641 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173016:0:22632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173034:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788846275.173047:0:22632:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014338913s 00010000:00010000:2.0:1788846275.173052:0:22632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173059:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173066:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173073:0:22632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173079:0:22632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaaa00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846275.173083:0:22632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173090:0:22632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173102:0:22632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173111:0:22632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846275.173130:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:3642:x1875740702514304:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846275.173136:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846275.173199:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702514304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846275.173208:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702514176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846275.173229:0:22663:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173237:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846275.173243:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aaaa00/0x21b4d56138273619 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846275.173377:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846275.173380:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846275.173382:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846275.173545:0:24149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24149:1875740702513792:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788846275.173556:0:24149:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788846275.173559:0:24149:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788846275.173561:0:24149:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788846275.173562:0:24149:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846275.173564:0:24149:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846275.173565:0:24149:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846275.173566:0:24149:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846275.173568:0:24149:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788846275.173569:0:24149:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846275.173571:0:24149:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788846275.173580:0:24149:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1788846275.178480:0:24149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788846275.181291:0:24149:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788846275.181308:0:24149:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788846275.181340:0:24149:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788846275.181382:0:24149:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788846275.181409:0:24149:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788846275.181432:0:24149:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788846275.185258:0:24149:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788846275.185472:0:24149:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788846275.390479:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788846276.332859:0:24228:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788846276.333379:0:24228:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788846276.410957:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788846276.921655:0:22644:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788846276.921663:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e47b586000 from 13 10000000:01000000:0.0:1788846276.921669:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788846276.921736:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846276.921748:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846276.921760:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846276.921783:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702514432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846276.921861:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846276.921906:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846276.922138:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702514432 00000100:00100000:3.0:1788846276.922146:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702514432 00000100:00100000:3.0:1788846276.922214:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788846276.922223:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+19:22644:x1875740702514432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846276.922235:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846276.922248:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42d000/0x21b4d56138273627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273620 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846276.922290:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42d000/0x21b4d56138273627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273620 expref: 20 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846276.922302:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42d000/0x21b4d56138273627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273620 expref: 20 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846276.922311:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d000, rc 0) 00000100:00100000:3.0:1788846276.922356:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:22644:x1875740702514432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846276.922363:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788846276.922725:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702514432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846276.922740:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846276.922748:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846276.922805:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702514560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788846276.922853:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846276.922883:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788846276.923046:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702514560 00000100:00100000:2.0:1788846276.923052:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702514560 00000100:00100000:2.0:1788846276.923087:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788846276.923095:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:22644:x1875740702514560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788846276.923108:0:22640:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788846276.923124:0:22640:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788846276.923127:0:22640:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788846276.923223:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:22644:x1875740702514560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846276.923230:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788846276.923435:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702514560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788846276.923496:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788846276.923505:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846276.923513:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846276.923551:0:22644:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788846276.923553:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e474598800 from 13 10000000:01000000:0.0:1788846276.923556:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788846276.923576:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846276.923584:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846276.925007:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846276.925034:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702514688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846276.925094:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846276.925217:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e479113e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846276.932134:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702514688 00000100:00100000:3.0:1788846276.932150:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702514688 00000100:00100000:2.0:1788846276.932533:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788846276.932544:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:22644:x1875740702514688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846276.932561:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846276.932577:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aaa800/0x21b4d56138273635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827362e expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846276.932616:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aaa800/0x21b4d56138273635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827362e expref: 21 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846276.932627:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aaa800/0x21b4d56138273635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827362e expref: 21 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846276.932637:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa800, rc 0) 00000100:00100000:2.0:1788846276.932714:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:22644:x1875740702514688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (7619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846276.932721:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788846276.932829:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702514688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846276.932846:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846276.932855:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846276.932926:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702514816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788846276.932961:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846276.932993:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342a0bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846276.933008:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702514816 00000100:00100000:1.0:1788846276.933011:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702514816 00000100:00100000:1.0:1788846276.933053:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788846276.933061:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:22644:x1875740702514816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788846276.933075:0:22642:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788846276.933090:0:22642:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788846276.933093:0:22642:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788846276.933168:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:22644:x1875740702514816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846276.933175:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788846276.933216:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702514816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788846276.933408:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788846276.933415:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846276.933442:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846277.434059:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788846277.898790:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788846278.460209:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846278.970132:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788846278.970157:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702514944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846278.970227:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846278.970824:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702515072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846278.970853:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846278.982412:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702514944 00000100:00100000:3.0:1788846278.982429:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702514944 00000100:00100000:3.0:1788846278.982482:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702515072 00000100:00100000:3.0:1788846278.982486:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702515072 00000100:00100000:3.0:1788846278.982593:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788846278.982606:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702514944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788846278.982645:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788846278.982727:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702514944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (12500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846278.982734:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788846278.982753:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788846278.982760:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702515072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788846278.982776:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788846278.982807:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702515072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (11954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846278.982814:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788846278.983294:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702515072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846278.983312:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702514944:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788846279.484725:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846280.505681:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788846280.522033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846280.522040:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846280.522043:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846280.522046:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846280.522075:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846280.522079:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846280.522081:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846280.522083:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846280.522133:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702515456:0@lo:400:kworker.0 00000100:00100000:2.0:1788846280.522202:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846280.522244:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702515968:0@lo:400:kworker.0 00000100:00100000:2.0:1788846280.522279:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846280.522305:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846280.522325:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702515584:0@lo:400:kworker.0 00000100:00100000:2.0:1788846280.522352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846280.522395:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702515456 00000100:00100000:2.0:1788846280.522407:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702515456 00000100:00100000:2.0:1788846280.522450:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702515968 00000100:00100000:2.0:1788846280.522453:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702515968 00000100:00100000:2.0:1788846280.522480:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788846280.522489:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702515456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846280.522568:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702515456:12345-0@lo:400:kworker.0 Request processed in 73us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846280.522576:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788846280.522593:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788846280.522600:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702515968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846280.522628:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702515968:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846280.522634:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788846280.522656:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702515584 00000100:00100000:2.0:1788846280.522659:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702515584 00000100:00100000:2.0:1788846280.522686:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788846280.522692:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702515584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846280.522873:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702515328:0@lo:400:kworker.0 00000100:00100000:0.0:1788846280.522907:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846280.522932:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702515840:0@lo:400:kworker.0 00000100:00100000:0.0:1788846280.522954:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846280.522975:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788846280.522980:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702515200:0@lo:400:kworker.0 00000100:00100000:0.0:1788846280.523006:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846280.523029:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702515712:0@lo:400:kworker.0 00000100:00100000:0.0:1788846280.523054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846280.523080:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702515200 00000100:00100000:0.0:1788846280.523083:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702515200 00000100:00100000:0.0:1788846280.523112:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788846280.523118:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:3643:x1875740702515200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846280.523152:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:3643:x1875740702515200:12345-0@lo:400:kworker.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846280.523159:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788846280.523205:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702515200:0@lo:400:kworker.0 00000100:00080000:3.0:1788846280.523617:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788846280.524941:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702515584:12345-0@lo:400:kworker.0 Request processed in 2242us (2581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846280.524954:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788846280.524980:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702515328 00000100:00100000:2.0:1788846280.524985:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702515328 00000100:00100000:2.0:1788846280.525010:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788846280.525016:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702515328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846280.525065:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702515328:12345-0@lo:400:kworker.0 Request processed in 49us (2156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846280.525072:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788846280.525098:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702515840 00000100:00100000:2.0:1788846280.525102:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702515840 00000100:00100000:2.0:1788846280.525127:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702515712 00000100:00100000:2.0:1788846280.525129:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702515712 00000100:00100000:2.0:1788846280.525140:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788846280.525145:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702515840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846280.525171:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702515840:12345-0@lo:400:kworker.0 Request processed in 26us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846280.525176:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788846280.525185:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788846280.525190:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702515712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846280.525208:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702515712:12345-0@lo:400:kworker.0 Request processed in 19us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846280.525213:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788846280.525228:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846280.525272:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702515584:0@lo:400:kworker.0 00010000:00080000:2.0:1788846280.525288:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e448f86d80 x1875740702515456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846280.525298:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702515456:0@lo:400:kworker.0 00010000:00080000:2.0:1788846280.525309:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e448f86680 x1875740702515968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846280.525318:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702515968:0@lo:400:kworker.0 00010000:00080000:1.0:1788846280.526580:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e448f87480 x1875740702515712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846280.526597:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702515712:0@lo:400:kworker.0 00000100:00100000:1.0:1788846280.526610:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702515328:0@lo:400:kworker.0 00010000:00080000:1.0:1788846280.526620:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e448f84700 x1875740702515840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846280.526628:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702515840:0@lo:400:kworker.0 00000040:00080000:3.0:1788846280.955015:0:23400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788846281.531182:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788846281.897887:0:24518:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788846282.553706:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788846283.027011:0:24571:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788846283.032788:0:24571:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788846283.321697:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846268/real 1788846268] req@ffff90e474542680 x1875740702508800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846283 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846283.321766:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e474542680 x1875740702508800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846283 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846283.321778:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846268/real 1788846268] req@ffff90e474543800 x1875740702508928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846283 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846283.321791:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e474543800 x1875740702508928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846283 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788846283.321819:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47f429800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846283.321856:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788846283.321861:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702508800:0@lo:8:kworker.0 00000100:00080000:0.0:1788846283.321867:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846283.321873:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788846283.321877:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702508928:0@lo:8:kworker.0 00000100:00080000:1.0:1788846283.322064:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846283.322069:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846283.322072:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846283.322075:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846283.322092:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846283.322095:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788846283.322099:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e47f429800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846283.322105:0:16008:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 652 00000100:00080000:1.0:1788846283.322111:0:16008:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788846283.322119:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90e47f429800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846283.322153:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474542d80 x1875740702516608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846283.322178:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846283.322181:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788846283.322183:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846283.322186:0:16008:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 652 00000100:00080000:1.0:1788846283.322189:0:16008:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788846283.322193:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e458351800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846283.322204:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474543480 x1875740702516736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846283.322260:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702516224:0@lo:400:kworker.0 00000100:00100000:1.0:1788846283.322343:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846283.322395:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702516992:0@lo:400:kworker.0 00000100:00100000:1.0:1788846283.322422:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846283.322446:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788846283.322451:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702516352:0@lo:400:kworker.0 00000100:00100000:1.0:1788846283.322472:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846283.322486:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702517120:0@lo:400:kworker.0 00000100:00100000:1.0:1788846283.322503:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846283.322574:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702516224 00000100:00100000:1.0:1788846283.322583:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702516224 00000100:00100000:1.0:1788846283.322633:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788846283.322642:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702516224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846283.322702:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702516224:12345-0@lo:400:kworker.0 Request processed in 60us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846283.322720:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788846283.322746:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702516992 00000100:00100000:1.0:1788846283.322750:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702516992 00000100:00100000:1.0:1788846283.322783:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702516352 00000100:00100000:1.0:1788846283.322786:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702516352 00000100:00100000:1.0:1788846283.322796:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702517120 00000100:00100000:1.0:1788846283.322798:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702517120 00000100:00100000:1.0:1788846283.322810:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788846283.322816:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702516992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846283.322848:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702516992:12345-0@lo:400:kworker.0 Request processed in 32us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846283.322854:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788846283.322865:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788846283.322871:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702516352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846283.322898:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702516352:12345-0@lo:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846283.322904:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788846283.322914:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788846283.322919:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702517120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846283.322940:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702517120:12345-0@lo:400:kworker.0 Request processed in 21us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846283.322945:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788846283.322970:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788846283.322974:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788846283.322999:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e474542680 x1875740702516352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846283.323013:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702516352:0@lo:400:kworker.0 00010000:00080000:1.0:1788846283.323032:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344574700 x1875740702517120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846283.323040:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702517120:0@lo:400:kworker.0 00000100:00100000:1.0:1788846283.323049:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702516224:0@lo:400:kworker.0 00010000:00080000:1.0:1788846283.323056:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344576680 x1875740702516992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846283.323065:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702516992:0@lo:400:kworker.0 00000100:00100000:3.0:1788846283.323700:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702516480:0@lo:400:kworker.0 00000100:00100000:3.0:1788846283.323756:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846283.323791:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788846283.323798:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3640:1875740702516096:0@lo:400:kworker.0 00000100:00100000:3.0:1788846283.323844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846283.323873:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702516864:0@lo:400:kworker.0 00000100:00100000:3.0:1788846283.323899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846283.325646:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702516480 00000100:00100000:3.0:1788846283.325663:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702516480 00000100:00100000:3.0:1788846283.325722:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788846283.325732:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702516480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846283.325843:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702516480:12345-0@lo:400:kworker.0 Request processed in 112us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846283.325850:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788846283.325879:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702516864 00000100:00100000:3.0:1788846283.325883:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702516864 00000100:00100000:3.0:1788846283.325911:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788846283.325917:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702516864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846283.325950:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702516864:12345-0@lo:400:kworker.0 Request processed in 34us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846283.325957:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788846283.326009:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e474540a80 x1875740702516864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846283.326028:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702516864:0@lo:400:kworker.0 00000100:00100000:3.0:1788846283.326043:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702516480:0@lo:400:kworker.0 00000100:00100000:0.0:1788846283.326467:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702516096 00000100:00100000:0.0:1788846283.326474:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702516096 00000100:00100000:0.0:1788846283.326511:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788846283.326534:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:3640:x1875740702516096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846283.326590:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:3640:x1875740702516096:12345-0@lo:400:kworker.0 Request processed in 72us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846283.326597:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788846283.326648:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3640:1875740702516096:0@lo:400:kworker.0 00000100:00100000:0.0:1788846283.326678:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702516608:0@lo:8:kworker.0 00000100:00100000:0.0:1788846283.326724:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846283.326764:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702516736:0@lo:8:kworker.0 00000100:00100000:0.0:1788846283.326795:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846283.339053:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702516608 00000100:00100000:2.0:1788846283.339074:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702516608 00000100:00100000:0.0:1788846283.339087:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702516736 00000100:00100000:0.0:1788846283.339092:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702516736 00000100:00100000:2.0:1788846283.339127:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846283.339137:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875740702516608:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788846283.339182:0:24155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 667 last 0 00000020:00000080:2.0:1788846283.339223:0:24155:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d5613827363c 00002000:00100000:2.0:1788846283.339254:0:24155:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff90e34440f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788846283.339259:0:24155:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788846283.339262:0:24155:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788846283.339481:0:24155:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788846283.339621:0:24155:0:(import.c:65:import_set_state_nolock()) ffff90e34440b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846283.339724:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875740702516608:12345-0@lo:8:kworker.0 Request processed in 587us (12998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846283.339733:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846283.339752:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788846283.339757:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875740702516736:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788846283.339770:0:24155:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788846283.349609:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e474542d80 x1875740702516608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788846303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846283.349633:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788846283.349648:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788846283.349662:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788846283.349679:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788846283.349684:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47f429800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788846283.349726:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788846283.349736:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702516608:0@lo:8:kworker.0 00000004:00080000:0.0:1788846283.349835:0:23389:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788846283.349872:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23389:1875740702517376:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788846283.349962:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846283.350149:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d6a8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788846283.350180:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702517248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788846283.350296:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846283.350349:0:24156:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788846283.350358:0:24156:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788846283.350394:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702517248 00000100:00100000:0.0:1788846283.350403:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702517248 00000100:00100000:0.0:1788846283.350481:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846283.350492:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1875740702517248:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788846283.372564:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846283.372632:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702517376 00000100:00100000:1.0:1788846283.372646:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702517376 00002000:00000024:0.0:1788846283.382073:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788846283.384659:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1875740702517248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34154us (34347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846283.384692:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788846283.384780:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e4745eea00 x1875740702517248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846283.384810:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702517248:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1788846283.387991:0:23388:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788846283.388139:0:23388:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 667425617335ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788846283.388147:0:23388:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788846283.390573:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788846283.390601:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23389:x1875740702517376:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788846283.397387:0:23380:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788846283.402961:0:24581:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788846283.403552:0:24581:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788846283.403719:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23389:x1875740702517376:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13124us (53750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846283.403741:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788846283.404084:0:23389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e4745ec380 x1875740702517376/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788846299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846283.404114:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23389:1875740702517376:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788846283.404132:0:23389:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788846283.404624:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23389:1875740702517504:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788846283.404684:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846283.404715:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788846283.404859:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702517504 00000100:00100000:1.0:1788846283.404867:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702517504 00000100:00100000:1.0:1788846283.404924:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788846283.404934:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23389:x1875740702517504:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788846283.407319:0:24156:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788846283.408364:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23389:x1875740702517504:12345-0@lo:5:osp-pre-0-1.0 Request processed in 3418us (3667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846283.408380:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788846283.421063:0:23389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344576680 x1875740702517504/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788846299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846283.421090:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23389:1875740702517504:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788846283.421123:0:23389:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788846283.425198:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23389:1875740702517632:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788846283.425309:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846283.425359:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788846283.426648:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875740702516736:12345-0@lo:8:kworker.0 Request processed in 86880us (99842us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788846283.426664:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788846283.426743:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846283.426749:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788846283.426754:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702516736:0@lo:8:kworker.0 00000100:00100000:2.0:1788846283.426787:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702517632 00000100:00100000:2.0:1788846283.426795:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702517632 00000100:00100000:2.0:1788846283.432479:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788846283.432502:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23389:x1875740702517632:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788846283.432590:0:24154:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1788846283.497162:0:24150:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788846283.497185:0:24150:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788846283.497538:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23389:x1875740702517632:12345-0@lo:5:osp-pre-0-1.0 Request processed in 65022us (72207us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788846283.497552:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788846283.497912:0:23389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344576680 x1875740702517632/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788846299 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846283.497926:0:23389:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788846283.497935:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23389:1875740702517632:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788846283.497953:0:23389:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1788846283.498029:0:23389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23389:1875740702517760:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788846283.498077:0:23389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846283.498118:0:23389:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846283.498269:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702517760 00000100:00100000:0.0:1788846283.498278:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702517760 00000100:00100000:0.0:1788846283.498336:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846283.498347:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23389:x1875740702517760:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788846283.498405:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23389:x1875740702517760:12345-0@lo:900:osp-pre-0-1.0 Request processed in 59us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846283.498411:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788846283.499508:0:23389:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344576680 x1875740702517760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788846299 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846283.499542:0:23389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23389:1875740702517760:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788846283.607200:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846284.094596:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702517888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846284.094671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846284.094732:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702517888 00000100:00100000:0.0:1788846284.094739:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702517888 00000100:00100000:0.0:1788846284.094787:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788846284.094797:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702517888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788846284.094829:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788846284.094873:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702517888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846284.094880:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788846284.094926:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702517888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846284.101009:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788846284.101036:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702518016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846284.101106:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846284.101436:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702518016 00000100:00100000:1.0:1788846284.101445:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702518016 00000100:00100000:1.0:1788846284.101497:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788846284.101507:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702518016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846284.101562:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846284.101621:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702518016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846284.101640:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788846284.101650:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702518016:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788846284.254793:0:24623:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788846284.255011:0:24623:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788846284.665749:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846285.691144:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846286.714011:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788846287.162400:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788846287.737714:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788846288.706634:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846288.706641:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788846288.706644:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846288.706647:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788846288.706663:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846288.706675:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788846288.706679:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846288.706686:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 667 00000100:00080000:0.0:1788846288.706691:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788846288.706697:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e458351800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846288.706716:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e448f86d80 x1875740702518784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846288.706792:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702518144:0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.706852:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846288.706893:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702518656:0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.706916:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846288.706930:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702519296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788846288.706947:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846288.707009:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788846288.707015:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702518528:0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707034:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846288.707049:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702519168:0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707078:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846288.707104:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702518272:0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707126:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846288.707141:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702518912:0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707158:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846288.707176:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788846288.707181:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702518400:0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707223:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846288.707237:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702519040:0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707256:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846288.707282:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702518144 00000100:00100000:0.0:1788846288.707289:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702518144 00000100:00100000:0.0:1788846288.707336:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788846288.707345:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:3643:x1875740702518144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707387:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:3643:x1875740702518144:12345-0@lo:400:kworker.0 Request processed in 43us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846288.707394:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788846288.707424:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702518656 00000100:00100000:0.0:1788846288.707427:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702518656 00000100:00100000:0.0:1788846288.707457:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846288.707462:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702518656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707488:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702518656:12345-0@lo:400:kworker.0 Request processed in 26us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846288.707494:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846288.707507:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702518528 00000100:00100000:0.0:1788846288.707510:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702518528 00000100:00100000:0.0:1788846288.707538:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702518272 00000100:00100000:0.0:1788846288.707540:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702518272 00000100:00100000:0.0:1788846288.707552:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788846288.707557:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702518528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707582:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702518528:12345-0@lo:400:kworker.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846288.707588:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788846288.707597:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788846288.707607:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702518272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707632:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702518272:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846288.707638:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788846288.707672:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702518272:0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707695:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702518528:0@lo:400:kworker.0 00000100:00100000:0.0:1788846288.707702:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702518144:0@lo:400:kworker.0 00010000:00080000:0.0:1788846288.707711:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e448f86680 x1875740702518656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788846304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846288.707720:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702518656:0@lo:400:kworker.0 00000100:00100000:1.0:1788846288.708695:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702519296 00000100:00100000:1.0:1788846288.708703:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702519296 00000100:00100000:1.0:1788846288.708735:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788846288.708742:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702519296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788846288.708767:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788846288.708843:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702519296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846288.708850:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788846288.708871:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702519168 00000100:00100000:1.0:1788846288.708875:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702519168 00000100:00100000:1.0:1788846288.708897:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702518912 00000100:00100000:1.0:1788846288.708900:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702518912 00000100:00100000:1.0:1788846288.708911:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702518400 00000100:00100000:1.0:1788846288.708913:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702518400 00000100:00100000:1.0:1788846288.708923:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702519040 00000100:00100000:1.0:1788846288.708926:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702519040 00000100:00100000:1.0:1788846288.708940:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788846288.708946:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702519168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846288.708977:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702519168:12345-0@lo:400:kworker.0 Request processed in 32us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846288.708982:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788846288.708993:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788846288.708998:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702518912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846288.709029:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702518912:12345-0@lo:400:kworker.0 Request processed in 31us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846288.709048:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788846288.709060:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788846288.709066:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702518400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846288.709222:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702518400:12345-0@lo:400:kworker.0 Request processed in 156us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846288.709229:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788846288.709240:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788846288.709247:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702519040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846288.709273:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702519040:12345-0@lo:400:kworker.0 Request processed in 28us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846288.709278:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788846288.709303:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788846288.709306:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788846288.709309:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788846288.709337:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e448f86300 x1875740702518400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846288.709350:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702518400:0@lo:400:kworker.0 00010000:00080000:1.0:1788846288.709361:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e448f84e00 x1875740702519040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846288.709369:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702519040:0@lo:400:kworker.0 00010000:00080000:1.0:1788846288.709381:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e448f85500 x1875740702518912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846288.709388:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702518912:0@lo:400:kworker.0 00010000:00080000:1.0:1788846288.709499:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e3445d4700 x1875740702519168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846288.709516:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702519168:0@lo:400:kworker.0 00010000:00080000:1.0:1788846288.709554:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e3445d7480 x1875740702519296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846288.709569:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702519296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788846288.720599:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702518784:0@lo:8:kworker.0 00000100:00100000:2.0:1788846288.720675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846288.724341:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702518784 00000100:00100000:0.0:1788846288.724356:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702518784 00000100:00100000:0.0:1788846288.724420:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788846288.724429:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875740702518784:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788846288.724453:0:24155:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788846288.724562:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875740702518784:12345-0@lo:8:kworker.0 Request processed in 133us (3887us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788846288.724569:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788846288.724810:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846288.724817:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788846288.724821:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702518784:0@lo:8:kworker.0 00010000:00010000:1.0:1788846288.761713:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846289.211877:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788846289.211900:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702519424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846289.211974:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846289.212327:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702519424 00000100:00100000:0.0:1788846289.212335:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702519424 00000100:00100000:0.0:1788846289.212389:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788846289.212399:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702519424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788846289.212429:0:22653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788846289.212473:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702519424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846289.212485:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788846289.212577:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702519424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846289.212794:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702519552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846289.212833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846289.213114:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702519552 00000100:00100000:2.0:1788846289.213119:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702519552 00000100:00100000:2.0:1788846289.213152:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788846289.213160:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702519552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846289.213178:0:22653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788846289.213231:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702519552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846289.213237:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788846289.213269:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702519552:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788846289.786656:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788846290.173486:0:23400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788846290.757085:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846270/real 1788846270] req@ffff90e4745ed180 x1875740702509824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846290 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846290.757115:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e4745ed180 x1875740702509824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846290 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846290.757141:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846270/real 1788846270] req@ffff90e4745ed880 x1875740702509952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846290 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846290.757154:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e4745ed880 x1875740702509952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846290 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788846290.757183:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e474533800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846290.757218:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788846290.757223:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702509824:0@lo:8:kworker.0 00000100:00080000:2.0:1788846290.757229:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343be3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846290.757234:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788846290.757237:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702509952:0@lo:8:kworker.0 00000100:00080000:0.0:1788846290.757411:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846290.757415:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788846290.757418:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e474533800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846290.757424:0:16008:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 654 00000100:00080000:0.0:1788846290.757429:0:16008:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788846290.757435:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90e474533800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846290.757458:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e3445d4e00 x1875740702519936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846290.757486:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846290.757489:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788846290.757491:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e343be3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846290.757494:0:16008:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 654 00000100:00080000:0.0:1788846290.757496:0:16008:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788846290.757500:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90e343be3000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846290.757511:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e3445d7100 x1875740702520064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846290.757571:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846290.757574:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788846290.757576:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846290.757579:0:16008:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 672 00000100:00080000:0.0:1788846290.757582:0:16008:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788846290.757585:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e458351800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846290.757598:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e3445d4000 x1875740702520576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846290.757662:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702519808:0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.757724:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846290.758012:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702520704:0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.758042:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846290.758066:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788846290.758073:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702519680:0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.758103:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846290.758137:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702520448:0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.758164:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846290.758203:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702520192:0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.758226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846290.758245:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702520832:0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.758264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846290.758283:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788846290.758289:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702520320:0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.758313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846290.758334:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4745ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702520960:0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.758355:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846290.758385:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702519808 00000100:00100000:0.0:1788846290.758392:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702519808 00000100:00100000:0.0:1788846290.758424:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702520320 00000100:00100000:0.0:1788846290.758427:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702520320 00000100:00100000:0.0:1788846290.758441:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788846290.758448:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702519808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.758911:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702519808:12345-0@lo:400:kworker.0 Request processed in 461us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846290.758919:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788846290.758940:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788846290.758947:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702520320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.758982:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702520320:12345-0@lo:400:kworker.0 Request processed in 36us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846290.758988:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788846290.759007:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702520704 00000100:00100000:0.0:1788846290.759011:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702520704 00000100:00100000:0.0:1788846290.759029:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702520192 00000100:00100000:0.0:1788846290.759032:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702520192 00000100:00100000:0.0:1788846290.759042:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702520832 00000100:00100000:0.0:1788846290.759044:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702520832 00000100:00100000:0.0:1788846290.759066:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702520960 00000100:00100000:0.0:1788846290.759070:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702520960 00000100:00100000:0.0:1788846290.759083:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788846290.759089:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702520704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.759117:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702520704:12345-0@lo:400:kworker.0 Request processed in 29us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846290.759123:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788846290.759133:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788846290.759137:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702520192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846290.759432:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702519808:0@lo:400:kworker.0 00010000:00080000:2.0:1788846290.759445:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e3445d7480 x1875740702520704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846290.759454:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702520704:0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.759855:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702520192:12345-0@lo:400:kworker.0 Request processed in 714us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846290.759863:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788846290.759881:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788846290.759898:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702520832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.759938:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702520832:12345-0@lo:400:kworker.0 Request processed in 42us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846290.759943:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788846290.759955:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788846290.759962:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702520960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.759986:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702520960:12345-0@lo:400:kworker.0 Request processed in 27us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846290.759993:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788846290.760013:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702519680 00000100:00100000:0.0:1788846290.760017:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702519680 00000100:00100000:0.0:1788846290.760043:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788846290.760049:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:3643:x1875740702519680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.760086:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:3643:x1875740702519680:12345-0@lo:400:kworker.0 Request processed in 36us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846290.760092:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788846290.760123:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702520448 00000100:00100000:0.0:1788846290.760128:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702520448 00000100:00100000:0.0:1788846290.760155:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788846290.762284:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702519936:0@lo:8:kworker.0 00000100:00100000:1.0:1788846290.762349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846290.762405:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702520064:0@lo:8:kworker.0 00000100:00100000:1.0:1788846290.762440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846290.763910:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702520576:0@lo:8:kworker.0 00000100:00100000:1.0:1788846290.764135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846290.764176:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702519936 00000100:00100000:1.0:1788846290.764184:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702519936 00000100:00100000:0.0:1788846290.764959:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702520448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846290.765033:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702520448:12345-0@lo:400:kworker.0 Request processed in 84us (6867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846290.767861:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702520064 00000100:00100000:1.0:1788846290.767875:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702520064 00000100:00100000:1.0:1788846290.767897:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702520576 00000100:00100000:1.0:1788846290.767899:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702520576 00000100:00100000:1.0:1788846290.767913:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788846290.767921:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875740702519936:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788846290.768561:0:24154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:1.0:1788846290.768608:0:24154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d56138273643 00002000:00100000:1.0:1788846290.768625:0:24154:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90e3427ca800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788846290.768629:0:24154:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788846290.768632:0:24154:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788846290.769120:0:24154:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788846290.769150:0:24154:0:(import.c:65:import_set_state_nolock()) ffff90e3427ca000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846290.769249:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1875740702519936:12345-0@lo:8:kworker.0 Request processed in 1327us (6899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846290.769258:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788846290.769281:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788846290.769287:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875740702520064:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788846290.769301:0:24154:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788846290.769330:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875740702520064:12345-0@lo:8:kworker.0 Request processed in 41us (6889us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788846290.769336:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788846290.769346:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788846290.769350:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875740702520576:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788846290.769360:0:24154:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788846290.769395:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875740702520576:12345-0@lo:8:kworker.0 Request processed in 43us (5261us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788846290.769401:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788846290.773322:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788846290.773332:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788846290.773335:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788846290.773568:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e3445d4e00 x1875740702519936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788846315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846290.773593:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788846290.773604:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788846290.773613:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788846290.773619:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788846290.773623:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e474533800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788846290.773660:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788846290.773667:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702519936:0@lo:8:kworker.0 00000100:00100000:0.0:1788846290.773895:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:0.0:1788846290.773966:0:22672:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1788846290.773987:0:22672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22672:1875740702521216:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788846290.774098:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3643:1875740702519680:0@lo:400:kworker.0 00010000:00080000:2.0:1788846290.774115:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e3445d5f80 x1875740702520448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788846306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846290.774125:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702520448:0@lo:400:kworker.0 00000100:00100000:2.0:1788846290.774145:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788846290.774719:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702521088:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788846290.775102:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343be3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846290.775109:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788846290.775114:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702520064:0@lo:8:kworker.0 00000100:00080000:1.0:1788846290.775127:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846290.775131:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788846290.775134:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702520576:0@lo:8:kworker.0 00000100:00100000:0.0:1788846290.775149:0:22672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788846290.775167:0:22671:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788846290.775209:0:22672:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4585703c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846290.775235:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702521216 00000100:00100000:0.0:1788846290.775242:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702521216 00000100:00080000:0.0:1788846290.775272:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788846290.775273:0:22671:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 674812751594ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788846290.775283:0:22671:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788846290.775321:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846290.775415:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846290.776881:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22672:x1875740702521216:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788846290.776967:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702520320:0@lo:400:kworker.0 00010000:00080000:2.0:1788846290.776984:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e4745ed880 x1875740702520960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846290.776995:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4745ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702520960:0@lo:400:kworker.0 00010000:00080000:2.0:1788846290.777008:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e3445d4380 x1875740702520192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846290.777017:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702520192:0@lo:400:kworker.0 00010000:00080000:2.0:1788846290.777033:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e3445d4700 x1875740702520832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846290.777042:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702520832:0@lo:400:kworker.0 00000100:00100000:1.0:1788846290.778210:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702521088 00000100:00100000:1.0:1788846290.778218:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702521088 00000100:00100000:1.0:1788846290.778301:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788846290.778312:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875740702521088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788846290.778336:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788846290.779107:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875740702521088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 795us (3688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846290.779116:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788846290.779182:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e448f87480 x1875740702521088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846290.779221:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702521088:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788846290.779776:0:24154:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788846290.779786:0:24154:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788846290.779792:0:24154:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:2.0:1788846290.792699:0:22627:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788846290.811298:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846290.811313:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d5613827364a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.811338:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788846290.811344:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846290.811350:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d5613827364a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.811369:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d5613827364a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.811380:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d5613827364a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.811389:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d5613827364a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.811417:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846290.811502:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846290.811510:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d5613827364a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.811544:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846290.811549:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d5613827364a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.811559:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d5613827364a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.811581:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d5613827364a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.811589:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d5613827364a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.811610:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.811612:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.815545:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846290.817131:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846290.817144:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138273651 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.817171:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=674s v=(0 0) 00010000:00010000:2.0:1788846290.817177:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846290.817183:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138273651 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.817207:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138273651 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.817233:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138273651 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.817240:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138273651 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.817272:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846290.817575:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846290.817583:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138273651 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.817600:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846290.817606:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138273651 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.817686:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138273651 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.817708:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138273651 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.817715:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138273651 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.817735:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.817737:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.817802:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846290.818409:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846290.818417:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bfc20ee/0x21b4d56138273658 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.818438:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=674s v=(0 0) 00010000:00010000:2.0:1788846290.818442:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846290.818448:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bfc20ee/0x21b4d56138273658 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.818459:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bfc20ee/0x21b4d56138273658 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.818467:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bfc20ee/0x21b4d56138273658 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.818474:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bfc20ee/0x21b4d56138273658 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.818502:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846290.818679:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846290.818685:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bfc20ee/0x21b4d56138273658 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.818694:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846290.818697:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bfc20ee/0x21b4d56138273658 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.818705:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bfc20ee/0x21b4d56138273658 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.818726:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bfc20ee/0x21b4d56138273658 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.818733:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bfc20ee/0x21b4d56138273658 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.818818:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.818820:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.818823:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846290.821196:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846290.821211:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a895a/0x21b4d5613827365f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.821227:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=674s v=(0 0) 00010000:00010000:2.0:1788846290.821232:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846290.821237:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a895a/0x21b4d5613827365f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.821251:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4a895a/0x21b4d5613827365f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.821262:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b4a895a/0x21b4d5613827365f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.821270:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b4a895a/0x21b4d5613827365f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.821295:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846290.821984:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846290.821993:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b4a895a/0x21b4d5613827365f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.822003:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846290.822008:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a895a/0x21b4d5613827365f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.822018:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b4a895a/0x21b4d5613827365f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.822035:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b4a895a/0x21b4d5613827365f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.822041:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4a895a/0x21b4d5613827365f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.822077:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.822079:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.822080:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846290.823142:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846290.823155:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273666 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.823169:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=674s v=(0 0) 00010000:00010000:2.0:1788846290.823181:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846290.823198:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273666 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.823212:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273666 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.823221:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273666 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.823229:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273666 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.823253:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846290.823809:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846290.823817:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273666 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.823827:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaac00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846290.823832:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273666 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.823840:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.823856:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273666 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.823863:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273666 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.823885:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.823887:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.823889:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.824255:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846290.826083:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846290.826096:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d5613827366d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.826112:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1788846290.826117:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846290.826201:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d5613827366d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.826219:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d5613827366d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.826230:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d5613827366d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.826238:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d5613827366d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.826329:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846290.827515:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788846290.828357:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846290.828370:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3ff6079/0x21b4d56138273674 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.828545:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1788846290.828550:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846290.828556:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3ff6079/0x21b4d56138273674 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.828569:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3ff6079/0x21b4d56138273674 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.828580:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3ff6079/0x21b4d56138273674 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.828588:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3ff6079/0x21b4d56138273674 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.828608:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846290.828910:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d5613827366d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.828931:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846290.829065:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d5613827366d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.829076:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d5613827366d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.829095:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d5613827366d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.829102:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d5613827366d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.829247:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846290.829252:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3ff6079/0x21b4d56138273674 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.829258:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42de00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846290.829261:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3ff6079/0x21b4d56138273674 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.829268:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3ff6079/0x21b4d56138273674 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.829279:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3ff6079/0x21b4d56138273674 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.829537:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3ff6079/0x21b4d56138273674 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.829553:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.829555:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.829557:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846290.829898:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846290.830113:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846290.830199:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d5613827367b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.830213:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1788846290.830217:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846290.830223:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d5613827367b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.830235:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d5613827367b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.830254:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d5613827367b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.830262:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d5613827367b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.830872:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788846290.834590:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846290.834604:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d56138273682 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.834621:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=674s v=(0 0) 00010000:00010000:3.0:1788846290.834627:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846290.834633:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d56138273682 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.834652:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d56138273682 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.834662:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d56138273682 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.834670:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d56138273682 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.837570:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846290.837834:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d5613827367b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.837850:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42ce00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846290.837856:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d5613827367b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.837868:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d5613827367b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.837889:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d5613827367b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.837904:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d5613827367b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.838072:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846290.838715:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846290.838722:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d56138273682 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.838732:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42da00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846290.838736:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d56138273682 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.838745:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d56138273682 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.838770:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d56138273682 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.838777:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d56138273682 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.838794:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.838796:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.838797:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.838815:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.838818:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.838819:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846290.840688:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846290.840708:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0eecf5/0x21b4d56138273689 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.840723:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=674s v=(0 0) 00010000:00010000:2.0:1788846290.840728:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846290.840733:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b0eecf5/0x21b4d56138273689 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.840746:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b0eecf5/0x21b4d56138273689 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.840756:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b0eecf5/0x21b4d56138273689 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.840763:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b0eecf5/0x21b4d56138273689 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.840786:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846290.840884:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846290.840891:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b0eecf5/0x21b4d56138273689 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.840900:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aabc00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846290.840915:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0eecf5/0x21b4d56138273689 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.840923:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b0eecf5/0x21b4d56138273689 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.841045:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b0eecf5/0x21b4d56138273689 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.841054:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0eecf5/0x21b4d56138273689 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.841070:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.841072:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.841073:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846290.841360:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846290.841366:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea078e5b/0x21b4d56138273690 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.841386:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=674s v=(0 0) 00010000:00010000:2.0:1788846290.841390:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846290.841394:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea078e5b/0x21b4d56138273690 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.841403:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea078e5b/0x21b4d56138273690 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.841412:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea078e5b/0x21b4d56138273690 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.841419:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea078e5b/0x21b4d56138273690 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.841452:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846290.841910:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846290.841917:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea078e5b/0x21b4d56138273690 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.841925:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846290.841929:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea078e5b/0x21b4d56138273690 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.841947:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea078e5b/0x21b4d56138273690 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.841960:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea078e5b/0x21b4d56138273690 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.841980:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea078e5b/0x21b4d56138273690 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.841997:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.841999:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.842000:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846290.842359:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846290.842367:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e0d8864/0x21b4d56138273697 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.842377:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=674s v=(0 0) 00010000:00010000:2.0:1788846290.842381:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846290.842385:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e0d8864/0x21b4d56138273697 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.842396:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e0d8864/0x21b4d56138273697 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.842416:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e0d8864/0x21b4d56138273697 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.842433:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e0d8864/0x21b4d56138273697 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.842456:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846290.843209:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846290.843217:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e0d8864/0x21b4d56138273697 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.843226:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaae00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846290.843231:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e0d8864/0x21b4d56138273697 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.843240:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e0d8864/0x21b4d56138273697 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.843256:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e0d8864/0x21b4d56138273697 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.843263:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e0d8864/0x21b4d56138273697 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.843279:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.843280:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.843282:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846290.843386:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846290.843392:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e1a91a/0x21b4d5613827369e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.843402:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=674s v=(0 0) 00010000:00010000:2.0:1788846290.843405:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846290.843410:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069e1a91a/0x21b4d5613827369e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.843419:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069e1a91a/0x21b4d5613827369e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.843438:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069e1a91a/0x21b4d5613827369e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.843446:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069e1a91a/0x21b4d5613827369e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.843482:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846290.844030:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846290.844038:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069e1a91a/0x21b4d5613827369e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.844046:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846290.844056:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e1a91a/0x21b4d5613827369e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.844065:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069e1a91a/0x21b4d5613827369e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.844078:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069e1a91a/0x21b4d5613827369e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.844085:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069e1a91a/0x21b4d5613827369e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.844099:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.844101:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.844102:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846290.845708:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846290.845719:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3c2fc49/0x21b4d561382736a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.845734:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788846290.845739:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846290.845745:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3c2fc49/0x21b4d561382736a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.845757:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3c2fc49/0x21b4d561382736a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.845766:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3c2fc49/0x21b4d561382736a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.845774:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3c2fc49/0x21b4d561382736a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.845796:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846290.846065:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846290.846072:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3c2fc49/0x21b4d561382736a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.846081:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846290.846085:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3c2fc49/0x21b4d561382736a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.846094:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3c2fc49/0x21b4d561382736a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.846110:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3c2fc49/0x21b4d561382736a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.846118:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3c2fc49/0x21b4d561382736a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.846145:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846290.846146:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846290.846148:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846290.847083:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846290.847097:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000166d13ca/0x21b4d561382736ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.847109:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788846290.847112:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846290.847117:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000166d13ca/0x21b4d561382736ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.847625:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000166d13ca/0x21b4d561382736ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.847636:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000166d13ca/0x21b4d561382736ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.847644:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000166d13ca/0x21b4d561382736ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.847663:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846290.848195:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846290.848203:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000166d13ca/0x21b4d561382736ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.848213:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0c200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846290.848217:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000166d13ca/0x21b4d561382736ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.848226:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000166d13ca/0x21b4d561382736ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.848242:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000166d13ca/0x21b4d561382736ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.848249:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000166d13ca/0x21b4d561382736ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.848270:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.848272:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.848274:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846290.848308:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846290.848315:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011ff8226/0x21b4d561382736b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.848326:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788846290.848329:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846290.848333:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011ff8226/0x21b4d561382736b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.848341:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011ff8226/0x21b4d561382736b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.848356:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011ff8226/0x21b4d561382736b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.848363:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011ff8226/0x21b4d561382736b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.848542:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788846290.848834:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846290.848840:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093dfe541/0x21b4d561382736ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.849044:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788846290.849050:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846290.849056:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093dfe541/0x21b4d561382736ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.849067:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093dfe541/0x21b4d561382736ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.849074:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093dfe541/0x21b4d561382736ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.849081:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093dfe541/0x21b4d561382736ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.851889:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846290.852042:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011ff8226/0x21b4d561382736b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.852058:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0cc00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846290.852063:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011ff8226/0x21b4d561382736b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.852074:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011ff8226/0x21b4d561382736b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.852096:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011ff8226/0x21b4d561382736b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.852119:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011ff8226/0x21b4d561382736b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.852272:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846290.852688:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846290.852693:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093dfe541/0x21b4d561382736ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.852700:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0de00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846290.852704:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093dfe541/0x21b4d561382736ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.852712:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093dfe541/0x21b4d561382736ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.852723:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093dfe541/0x21b4d561382736ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.852730:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093dfe541/0x21b4d561382736ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.852743:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.852745:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.852748:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846290.852974:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846290.854096:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846290.854108:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000324e39b6/0x21b4d561382736c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.854321:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788846290.854327:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846290.854334:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000324e39b6/0x21b4d561382736c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.854348:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000324e39b6/0x21b4d561382736c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.854358:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000324e39b6/0x21b4d561382736c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.854366:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000324e39b6/0x21b4d561382736c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.854547:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846290.854848:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846290.854865:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000324e39b6/0x21b4d561382736c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.854882:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0c600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846290.854886:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000324e39b6/0x21b4d561382736c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.854894:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000324e39b6/0x21b4d561382736c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.854919:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000324e39b6/0x21b4d561382736c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.854927:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000324e39b6/0x21b4d561382736c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.855054:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.855057:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.855059:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846290.855281:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846290.855288:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c9a1257/0x21b4d561382736c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.855297:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788846290.855307:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846290.855312:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c9a1257/0x21b4d561382736c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.855322:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c9a1257/0x21b4d561382736c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.855330:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c9a1257/0x21b4d561382736c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.855338:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c9a1257/0x21b4d561382736c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.855362:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846290.855460:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846290.855465:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c9a1257/0x21b4d561382736c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.855473:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0c800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846290.855477:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c9a1257/0x21b4d561382736c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.855485:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c9a1257/0x21b4d561382736c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.855503:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c9a1257/0x21b4d561382736c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.855511:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c9a1257/0x21b4d561382736c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.855539:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.855541:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.855543:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846290.856595:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846290.856604:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f64ad8cb/0x21b4d561382736cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.856617:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788846290.856621:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846290.856626:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f64ad8cb/0x21b4d561382736cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.856635:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f64ad8cb/0x21b4d561382736cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.856644:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f64ad8cb/0x21b4d561382736cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.856659:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f64ad8cb/0x21b4d561382736cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.856681:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846290.856943:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846290.856952:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f64ad8cb/0x21b4d561382736cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.856971:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f2a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846290.856976:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f64ad8cb/0x21b4d561382736cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.856983:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f64ad8cb/0x21b4d561382736cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.856998:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f64ad8cb/0x21b4d561382736cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.857005:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f64ad8cb/0x21b4d561382736cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.857023:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846290.857025:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846290.857027:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846290.859324:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846290.859337:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000346d1263/0x21b4d561382736d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.859353:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788846290.859358:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846290.859363:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000346d1263/0x21b4d561382736d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.859391:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000346d1263/0x21b4d561382736d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.859401:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000346d1263/0x21b4d561382736d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.859408:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000346d1263/0x21b4d561382736d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.859437:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846290.859598:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846290.859607:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000346d1263/0x21b4d561382736d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.859615:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846290.859619:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000346d1263/0x21b4d561382736d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.859649:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000346d1263/0x21b4d561382736d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.859665:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000346d1263/0x21b4d561382736d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.859674:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.859676:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.859678:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846290.860706:0:24154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000346d1263/0x21b4d561382736d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788846290.862084:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846290.862096:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4c6a3de/0x21b4d561382736dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.862112:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788846290.862117:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846290.862136:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4c6a3de/0x21b4d561382736dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.862149:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4c6a3de/0x21b4d561382736dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.862169:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4c6a3de/0x21b4d561382736dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.862176:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4c6a3de/0x21b4d561382736dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.862204:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846290.863686:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846290.863700:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4c6a3de/0x21b4d561382736dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.863714:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846290.863719:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4c6a3de/0x21b4d561382736dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.863729:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4c6a3de/0x21b4d561382736dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.863831:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4c6a3de/0x21b4d561382736dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.863839:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4c6a3de/0x21b4d561382736dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.863883:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.863885:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.863887:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846290.864684:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846290.864697:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009984e702/0x21b4d561382736e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.864711:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=674s v=(0 0) 00010000:00010000:0.0:1788846290.864715:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846290.864739:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009984e702/0x21b4d561382736e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.864752:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009984e702/0x21b4d561382736e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.864760:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009984e702/0x21b4d561382736e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.864768:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009984e702/0x21b4d561382736e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.864791:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846290.866148:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846290.866158:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009984e702/0x21b4d561382736e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.866170:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846290.866176:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009984e702/0x21b4d561382736e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.866194:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009984e702/0x21b4d561382736e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.866215:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009984e702/0x21b4d561382736e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.866223:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009984e702/0x21b4d561382736e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.866243:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.866245:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.866247:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846290.869907:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846290.869922:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382736eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.869951:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788846290.869957:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846290.869963:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382736eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.869977:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382736eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.869987:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382736eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.869995:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382736eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.870027:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846290.870037:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846290.870043:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382736eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.870050:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846290.870054:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382736eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.870063:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382736eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.870079:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382736eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.870087:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382736eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.870104:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.870105:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.870107:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846290.872163:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846290.872175:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d561382736f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.872199:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788846290.872211:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846290.872218:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d561382736f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.872232:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d561382736f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.872243:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d561382736f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.872250:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d561382736f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.872276:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846290.872537:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846290.872545:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d561382736f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.872564:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846290.872569:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d561382736f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.872577:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d561382736f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.872592:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d561382736f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.872599:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b61600d/0x21b4d561382736f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.872615:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.872617:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.872618:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846290.873201:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846290.873209:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000350dd7ca/0x21b4d561382736f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.873219:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788846290.873222:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846290.873227:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000350dd7ca/0x21b4d561382736f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.873237:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000350dd7ca/0x21b4d561382736f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.873245:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000350dd7ca/0x21b4d561382736f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.873258:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000350dd7ca/0x21b4d561382736f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.873269:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846290.873669:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846290.873676:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000350dd7ca/0x21b4d561382736f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.873685:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846290.873689:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000350dd7ca/0x21b4d561382736f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.873698:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000350dd7ca/0x21b4d561382736f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.873719:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000350dd7ca/0x21b4d561382736f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.874546:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000350dd7ca/0x21b4d561382736f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846290.874569:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846290.874571:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846290.874573:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846290.875606:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846290.875616:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d3eda52/0x21b4d56138273700 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.875629:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788846290.875634:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846290.875640:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d3eda52/0x21b4d56138273700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.875653:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d3eda52/0x21b4d56138273700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.875738:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d3eda52/0x21b4d56138273700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.875747:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d3eda52/0x21b4d56138273700 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.875770:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788846290.876351:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846290.876359:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c335b00c/0x21b4d56138273707 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.876374:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788846290.876377:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846290.876381:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c335b00c/0x21b4d56138273707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.876391:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c335b00c/0x21b4d56138273707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.876398:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c335b00c/0x21b4d56138273707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.876406:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c335b00c/0x21b4d56138273707 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.876569:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788846290.877341:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846290.877349:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003db2d1a5/0x21b4d5613827370e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877359:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788846290.877363:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846290.877368:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003db2d1a5/0x21b4d5613827370e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877377:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003db2d1a5/0x21b4d5613827370e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877397:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003db2d1a5/0x21b4d5613827370e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877404:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003db2d1a5/0x21b4d5613827370e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877434:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788846290.877445:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788846290.877451:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d3eda52/0x21b4d56138273700 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877458:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846290.877461:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d3eda52/0x21b4d56138273700 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877469:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d3eda52/0x21b4d56138273700 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877485:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d3eda52/0x21b4d56138273700 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877491:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d3eda52/0x21b4d56138273700 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877512:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788846290.877546:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c335b00c/0x21b4d56138273707 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877552:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846290.877555:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c335b00c/0x21b4d56138273707 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877562:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c335b00c/0x21b4d56138273707 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877571:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c335b00c/0x21b4d56138273707 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877578:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c335b00c/0x21b4d56138273707 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877592:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846290.877595:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003db2d1a5/0x21b4d5613827370e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877601:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846290.877604:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003db2d1a5/0x21b4d5613827370e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877612:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003db2d1a5/0x21b4d5613827370e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877634:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003db2d1a5/0x21b4d5613827370e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877642:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003db2d1a5/0x21b4d5613827370e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.877884:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.877886:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.877888:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846290.878602:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846290.878609:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007181efbd/0x21b4d56138273715 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.878621:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788846290.878625:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846290.878630:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007181efbd/0x21b4d56138273715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.878640:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007181efbd/0x21b4d56138273715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.878649:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007181efbd/0x21b4d56138273715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.878790:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007181efbd/0x21b4d56138273715 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.878820:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846290.878831:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846290.878836:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007181efbd/0x21b4d56138273715 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.878843:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846290.878846:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007181efbd/0x21b4d56138273715 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.878855:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007181efbd/0x21b4d56138273715 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.878867:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007181efbd/0x21b4d56138273715 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.878875:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007181efbd/0x21b4d56138273715 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.878890:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.878891:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.878893:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.881404:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846290.882673:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846290.882688:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9aa9eb8/0x21b4d5613827371c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846290.883268:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846290.883334:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=674s v=(0 0) 00010000:00010000:1.0:1788846290.883339:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846290.883346:0:24154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9aa9eb8/0x21b4d5613827371c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.883360:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9aa9eb8/0x21b4d5613827371c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.883370:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9aa9eb8/0x21b4d5613827371c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.883378:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9aa9eb8/0x21b4d5613827371c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846290.883400:0:24154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788846290.883582:0:24154:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:1.0:1788846290.883690:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22672:x1875740702521216:12345-0@lo:5:osp-pre-0-0.0 Request processed in 108356us (108539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846290.883836:0:22672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22672:1875740702521216:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788846290.883869:0:22672:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:0.0:1788846290.884049:0:22672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22672:1875740702521344:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788846290.884101:0:22672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846290.884592:0:22672:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e44613de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846290.884621:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702521344 00000100:00100000:0.0:1788846290.884630:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702521344 00000100:00100000:0.0:1788846290.884685:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788846290.884695:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:22672:x1875740702521344:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788846290.884863:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00002000:00080000:0.0:1788846290.885002:0:24155:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:3.0:1788846290.886592:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846290.886604:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9aa9eb8/0x21b4d5613827371c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.886617:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846290.886622:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9aa9eb8/0x21b4d5613827371c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.886633:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9aa9eb8/0x21b4d5613827371c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.886674:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9aa9eb8/0x21b4d5613827371c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.886682:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9aa9eb8/0x21b4d5613827371c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846290.886715:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.886717:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846290.886719:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788846290.911239:0:24150:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1788846290.911662:0:24150:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788846290.912088:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22672:x1875740702521344:12345-0@lo:5:osp-pre-0-0.0 Request processed in 27388us (27980us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788846290.912099:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788846290.912718:0:22672:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788846290.912789:0:22672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22672:1875740702521344:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788846290.912805:0:22672:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000020:01000004:2.0:1788846291.822516:0:24970:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788846291.822920:0:24970:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788846291.822922:0:24970:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788846291.823102:0:24970:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90e34440e000 00000020:01000004:2.0:1788846291.823119:0:24970:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788846291.823134:0:24970:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788846291.823146:0:24970:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90e4752ecd28) 00000020:00000080:2.0:1788846291.823162:0:24970:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1788846291.834691:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788846291.867451:0:24970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788846291.869050:0:24970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788846291.869286:0:24970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788846291.869497:0:24970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788846291.869875:0:24970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788846291.870040:0:24970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788846291.870230:0:24970:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1788846291.872670:0:24970:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788846291.872891:0:24970:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788846291.872905:0:24970:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788846291.872916:0:24970:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x21b4d5613827372a 00000020:01000004:1.0:1788846291.872923:0:24970:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788846291.872945:0:24970:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788846291.872948:0:24970:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788846291.872953:0:24970:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788846291.872981:0:24970:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788846291.872985:0:24970:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788846291.879985:0:24970:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788846291.880028:0:24970:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788846291.880036:0:24970:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788846291.880038:0:24970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788846291.880039:0:24970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846291.880040:0:24970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846291.880042:0:24970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846291.880043:0:24970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846291.880045:0:24970:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788846291.880046:0:24970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846291.880048:0:24970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788846291.880051:0:24970:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788846291.880053:0:24970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788846291.880055:0:24970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788846291.880056:0:24970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846291.880057:0:24970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846291.880058:0:24970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846291.880059:0:24970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846291.880060:0:24970:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788846291.880061:0:24970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846291.880063:0:24970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788846291.880086:0:24970:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788846291.880104:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702521472:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788846291.880234:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846291.880326:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788846291.880366:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702521472 00000100:00100000:2.0:1788846291.880374:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702521472 00000100:00100000:2.0:1788846291.880453:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788846291.880463:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24970:x1875740702521472:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788846291.880498:0:22640:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788846291.880502:0:22640:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788846291.880506:0:22640:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788846291.880841:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24970:x1875740702521472:12345-0@lo:253:mount.lustre.0 Request processed in 379us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846291.880849:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788846291.880918:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702521472:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788846291.880928:0:24970:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788846291.880931:0:24970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788846291.880933:0:24970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788846291.880934:0:24970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846291.880935:0:24970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846291.880936:0:24970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846291.880938:0:24970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846291.880939:0:24970:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788846291.880941:0:24970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846291.880942:0:24970:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788846291.880958:0:24970:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e34440e000 from lustre-OST0001 10000000:01000000:1.0:1788846291.880994:0:24970:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788846291.880997:0:24970:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788846291.881006:0:24970:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90e449bd99b8 local copy 00010000:00010000:1.0:1788846291.881021:0:24970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846291.881105:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702521600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846291.881134:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846291.881492:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702521600 00000100:00100000:0.0:1788846291.881498:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702521600 00000100:00100000:0.0:1788846291.881548:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788846291.881557:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24970:x1875740702521600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846291.881621:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24970:x1875740702521600:12345-0@lo:501:mount.lustre.0 Request processed in 66us (486us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788846291.881629:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788846291.881911:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788846291.881927:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702521600:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788846291.881945:0:24970:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788846291.881965:0:24970:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788846291.881973:0:24970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846291.881983:0:24970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138273364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827336b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846291.882009:0:24970:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e34440e000 10000000:01000000:3.0:1788846291.882013:0:24970:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788846291.882019:0:24970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788846291.882021:0:24970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788846291.882026:0:24970:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788846291.882029:0:24970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788846291.882052:0:24970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138273731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846291.882069:0:24970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138273731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846291.882080:0:24970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138273731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846291.882095:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702521728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846291.882124:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846291.882251:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469bf53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846291.882293:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702521728 00000100:00100000:0.0:1788846291.882297:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702521728 00000100:00100000:0.0:1788846291.882357:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788846291.882365:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:24970:x1875740702521728:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846291.882382:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846291.882395:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4752f3800/0x21b4d56138273738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273731 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846291.882418:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4752f3800/0x21b4d56138273738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273731 expref: 22 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846291.882431:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4752f3800/0x21b4d56138273738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273731 expref: 22 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846291.882440:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f3800, rc 0) 00000100:00100000:0.0:1788846291.882514:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:24970:x1875740702521728:12345-0@lo:101:mount.lustre.0 Request processed in 149us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846291.882548:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788846291.882693:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702521728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846291.882706:0:24970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138273731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273738 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846291.882716:0:24970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138273731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273738 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788846291.883570:0:24970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1788846291.884036:0:24970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788846291.885736:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788846291.885780:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788846291.885796:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788846291.885808:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788846291.885821:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788846291.885833:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788846291.885846:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788846291.885858:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788846291.885871:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1788846291.885892:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1788846291.885897:0:24970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1788846291.885997:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702521856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846291.886063:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.886166:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d6bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788846291.886269:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702521856 00000100:00100000:3.0:1788846291.886276:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702521856 00000100:00100000:3.0:1788846291.886373:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788846291.886383:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:24970:x1875740702521856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846291.886550:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:24970:x1875740702521856:12345-0@lo:501:mount.lustre.0 Request processed in 169us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846291.886558:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788846291.886649:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702521856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846291.886691:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702521984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846291.886726:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.886869:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d6bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788846291.886929:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702521984 00000100:00100000:2.0:1788846291.886933:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702521984 00000100:00100000:2.0:1788846291.886955:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788846291.886961:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:24970:x1875740702521984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846291.887673:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:24970:x1875740702521984:12345-0@lo:503:mount.lustre.0 Request processed in 709us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846291.887681:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788846291.887823:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702521984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788846291.888274:0:24970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788846291.888345:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846291.888395:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.888479:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d6bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788846291.888513:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702522112 00000100:00100000:3.0:1788846291.889392:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702522112 00000100:00100000:3.0:1788846291.889453:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788846291.889463:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:24970:x1875740702522112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846291.892004:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:24970:x1875740702522112:12345-0@lo:502:mount.lustre.0 Request processed in 2534us (3599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846291.892017:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788846291.892215:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846291.892473:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788846291.892504:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788846291.892553:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788846291.892571:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788846291.892584:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788846291.892597:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788846291.892609:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788846291.892622:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788846291.892634:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788846291.892665:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846291.892713:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.892757:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d6bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846291.892812:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702522240 00000100:00100000:0.0:1788846291.892819:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702522240 00000100:00100000:0.0:1788846291.892858:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788846291.892866:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:24970:x1875740702522240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846291.892973:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:24970:x1875740702522240:12345-0@lo:502:mount.lustre.0 Request processed in 107us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846291.892980:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788846291.893087:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846291.893125:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1788846291.893132:0:24970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788846291.894084:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788846291.894094:0:24974:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788846291.894108:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846291.894110:0:24974:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788846291.894116:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788846291.894130:0:24974:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90e46d518000) 00000020:00000080:1.0:1788846291.894163:0:24974:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788846291.894170:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788846291.894259:0:24974:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e34440e000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788846291.894267:0:24974:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788846291.894274:0:24974:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x21b4d56138273746 00010000:00010000:1.0:1788846291.897287:0:24974:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788846291.897715:0:24974:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1788846291.898755:0:24974:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788846291.900083:0:24974:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788846291.900094:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846291.900101:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846291.900107:0:24974:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788846291.900111:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846291.900115:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846291.900117:0:24974:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788846291.900120:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788846291.900123:0:24974:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788846291.900125:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846291.900127:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846291.900129:0:24974:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788846291.900131:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846291.900134:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846291.900135:0:24974:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788846291.900138:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788846291.900178:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846291.900190:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846291.900191:0:24974:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788846291.900194:0:24974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788846291.900352:0:24970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788846291.900380:0:24970:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788846291.900405:0:24970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138273731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273738 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846291.900418:0:24970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138273731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273738 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846291.900439:0:24970:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e34440e000 from 1 10000000:01000000:0.0:1788846291.900442:0:24970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788846291.900477:0:24970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846291.900486:0:24970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846291.900497:0:24970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846291.900547:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788846291.900612:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846291.900648:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4821ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1788846291.900768:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702522368 00000100:00100000:3.0:1788846291.900775:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702522368 00000100:00100000:3.0:1788846291.900812:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788846291.900820:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:24970:x1875740702522368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846291.900834:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846291.900847:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42da00/0x21b4d56138273754 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827374d expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846291.900871:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42da00/0x21b4d56138273754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827374d expref: 23 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846291.900882:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42da00/0x21b4d56138273754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827374d expref: 23 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846291.900892:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42da00, rc 0) 00000100:00100000:3.0:1788846291.900946:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:24970:x1875740702522368:12345-0@lo:101:mount.lustre.0 Request processed in 126us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846291.900953:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788846291.901030:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846291.901045:0:24970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846291.901059:0:24970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846291.903485:0:24970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788846291.903933:0:24970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846291.905724:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788846291.905766:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788846291.905780:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788846291.905793:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788846291.905820:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788846291.905834:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788846291.905846:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788846291.905858:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788846291.905870:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788846291.905882:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788846291.905901:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788846291.905921:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788846291.905926:0:24970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788846291.906013:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846291.906074:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846291.906300:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e460457b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846291.906420:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702522496 00000100:00100000:3.0:1788846291.906428:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702522496 00000100:00100000:3.0:1788846291.906543:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788846291.906553:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:24970:x1875740702522496:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846291.906659:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:24970:x1875740702522496:12345-0@lo:501:mount.lustre.0 Request processed in 107us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846291.906667:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788846291.906738:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846291.906769:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522624:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846291.906806:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846291.906915:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e460457b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846291.906968:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702522624 00000100:00100000:0.0:1788846291.906972:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702522624 00000100:00100000:0.0:1788846291.906996:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788846291.907003:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:24970:x1875740702522624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846291.907139:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:24970:x1875740702522624:12345-0@lo:503:mount.lustre.0 Request processed in 136us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846291.907146:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788846291.907390:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522624:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788846291.907770:0:24970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788846291.907836:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846291.907879:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846291.907909:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e460457900 going to sleep for 11 seconds 00000100:00100000:3.0:1788846291.908011:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702522752 00000100:00100000:3.0:1788846291.908016:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702522752 00000100:00100000:3.0:1788846291.908286:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788846291.908297:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:24970:x1875740702522752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846291.908414:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:24970:x1875740702522752:12345-0@lo:502:mount.lustre.0 Request processed in 119us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846291.908423:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788846291.908493:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846291.908679:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788846291.908704:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788846291.908716:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788846291.908729:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788846291.908741:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788846291.908753:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788846291.908778:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788846291.908790:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788846291.908802:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788846291.908815:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788846291.908827:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788846291.908855:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846291.908888:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846291.909062:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e460457900 going to sleep for 11 seconds 00000100:00100000:0.0:1788846291.909219:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702522880 00000100:00100000:0.0:1788846291.909224:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702522880 00000100:00100000:0.0:1788846291.909250:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788846291.909257:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:24970:x1875740702522880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846291.909348:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:24970:x1875740702522880:12345-0@lo:502:mount.lustre.0 Request processed in 91us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846291.909364:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788846291.909451:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702522880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846291.909491:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788846291.909500:0:24970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788846291.910281:0:24978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846291.910292:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846291.910295:0:24978:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788846291.910306:0:24978:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e34440e000 00000020:00000080:0.0:1788846291.910310:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846291.910317:0:24978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846291.910320:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846291.910321:0:24978:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788846291.910324:0:24978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846291.910326:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846291.910328:0:24978:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788846291.910331:0:24978:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e34440e000 00000020:00000080:0.0:1788846291.910334:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846291.910428:0:24978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846291.910433:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846291.910434:0:24978:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788846291.910438:0:24978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846291.910442:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846291.910443:0:24978:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788846291.910448:0:24978:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e34440e000 00000020:00000080:0.0:1788846291.910451:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846291.911325:0:24978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846291.911334:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846291.911336:0:24978:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788846291.911341:0:24978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846291.911345:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846291.911346:0:24978:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788846291.911351:0:24978:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e34440e000 00000020:00000080:0.0:1788846291.911353:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846291.911391:0:24978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846291.911394:0:24978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846291.911402:0:24978:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788846291.911406:0:24978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788846291.913296:0:24970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788846291.913346:0:24970:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788846291.913373:0:24970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846291.913386:0:24970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846291.913452:0:24970:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788846291.913455:0:24970:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e34440e000 10000000:01000000:1.0:1788846291.913458:0:24970:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e34440e000 10000000:01000000:1.0:1788846291.913463:0:24970:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788846291.913468:0:24970:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e34440e000 from 1 10000000:01000000:1.0:1788846291.913471:0:24970:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788846291.913508:0:24970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46f358000/0x21b4d5613827375b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846291.913516:0:24970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46f358000/0x21b4d5613827375b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846291.913597:0:24970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46f358000/0x21b4d5613827375b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846291.913623:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788846291.913771:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.913809:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788846291.914381:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702523008 00000100:00100000:0.0:1788846291.914390:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702523008 00000100:00100000:0.0:1788846291.914446:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788846291.914457:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:24970:x1875740702523008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846291.914470:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846291.914485:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4752f2200/0x21b4d56138273762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827375b expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846291.914508:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4752f2200/0x21b4d56138273762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827375b expref: 24 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846291.914872:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4752f2200/0x21b4d56138273762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827375b expref: 24 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846291.914884:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f2200, rc 0) 00000100:00100000:0.0:1788846291.914988:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702523008:12345-0@lo:101:mount.lustre.0 Request processed in 532us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846291.914996:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788846291.915298:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846291.915317:0:24970:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46f358000/0x21b4d5613827375b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273762 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846291.915328:0:24970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46f358000/0x21b4d5613827375b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273762 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788846291.933457:0:24970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788846291.933839:0:24970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846291.934502:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788846291.934575:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788846291.934595:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788846291.934623:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788846291.934642:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788846291.934658:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788846291.934674:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788846291.934690:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788846291.934705:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788846291.934739:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788846291.934771:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788846291.934789:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788846291.934807:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788846291.934824:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788846291.934844:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788846291.934863:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788846291.934880:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788846291.934897:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788846291.934917:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788846291.934934:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788846291.934951:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788846291.934970:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788846291.934988:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788846291.935357:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788846291.935381:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788846291.935416:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788846291.935439:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788846291.935458:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788846291.935475:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788846291.935490:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788846291.935504:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788846291.936278:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788846291.936301:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788846291.936318:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788846291.936336:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788846291.936352:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788846291.936367:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788846291.936383:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788846291.936403:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788846291.936419:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788846291.936433:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788846291.936461:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788846291.936478:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788846291.936504:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788846291.936818:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788846291.936840:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788846291.937060:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788846291.937084:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788846291.937363:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788846291.937385:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788846291.937402:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788846291.937407:0:24970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788846291.937609:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846291.938667:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846291.938707:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420780 going to sleep for 11 seconds 00000100:00100000:1.0:1788846291.942277:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702523136 00000100:00100000:1.0:1788846291.942290:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702523136 00000100:00100000:1.0:1788846291.942349:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788846291.942359:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702523136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846291.942740:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702523136:12345-0@lo:501:mount.lustre.0 Request processed in 381us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846291.942747:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788846291.945734:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846291.945795:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846291.946303:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846291.946402:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420780 going to sleep for 11 seconds 00000100:00100000:2.0:1788846291.946452:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702523264 00000100:00100000:2.0:1788846291.946459:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702523264 00000100:00100000:2.0:1788846291.946756:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788846291.946769:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702523264:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846291.946913:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702523264:12345-0@lo:503:mount.lustre.0 Request processed in 148us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846291.946920:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788846291.947487:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523264:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788846291.948299:0:24970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788846291.948391:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846291.948450:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846291.948494:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420780 going to sleep for 11 seconds 00000100:00100000:0.0:1788846291.948721:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702523392 00000100:00100000:0.0:1788846291.948728:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702523392 00000100:00100000:0.0:1788846291.948774:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788846291.948784:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702523392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846291.948905:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702523392:12345-0@lo:502:mount.lustre.0 Request processed in 121us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846291.948912:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788846291.949379:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846291.949619:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788846291.949647:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788846291.949660:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788846291.949765:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788846291.949784:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788846291.949798:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788846291.949811:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788846291.949835:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788846291.949914:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788846291.950241:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788846291.950263:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788846291.950278:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788846291.950290:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788846291.950303:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788846291.950315:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788846291.950328:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788846291.950356:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788846291.950372:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788846291.950385:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788846291.950399:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788846291.950413:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788846291.950426:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788846291.950437:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788846291.950448:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788846291.950459:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788846291.950472:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788846291.950483:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788846291.950494:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788846291.950506:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788846291.950649:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788846291.950761:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788846291.950781:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788846291.950809:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788846291.950823:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788846291.950836:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788846291.950919:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788846291.951432:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788846291.951449:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788846291.951462:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788846291.951473:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788846291.951497:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788846291.951511:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788846291.952618:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788846291.952645:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788846291.952657:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788846291.952730:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788846291.952749:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788846291.952763:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788846291.952834:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846291.953619:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846291.956312:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e344420780 going to sleep for 11 seconds 00000100:00100000:0.0:1788846291.957683:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702523520 00000100:00100000:0.0:1788846291.957698:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702523520 00000100:00100000:0.0:1788846291.957794:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788846291.957804:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702523520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846291.958031:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702523520:12345-0@lo:502:mount.lustre.0 Request processed in 229us (4414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846291.958039:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788846291.961574:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846291.962093:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788846291.963749:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788846291.963802:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846291.964581:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.964629:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342a0bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846291.967392:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702523648 00000100:00100000:0.0:1788846291.967405:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702523648 00000100:00100000:0.0:1788846291.967466:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788846291.967475:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702523648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846291.967667:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702523648:12345-0@lo:502:mount.lustre.0 Request processed in 192us (3086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846291.967674:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788846291.967795:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702523648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846291.968074:0:24970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788846291.968089:0:24970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788846291.972985:0:24983:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788846291.973014:0:24983:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90e46d5199b8) 00000020:00000080:1.0:1788846291.973042:0:24983:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788846291.973393:0:24983:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e34440e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788846291.973398:0:24983:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e34440e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788846291.973401:0:24983:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e34440e000 3 00010000:00080000:1.0:1788846291.973427:0:24983:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e3427ce800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1788846291.975498:0:24983:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788846291.975796:0:24983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788846291.977651:0:24983:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788846291.977677:0:24983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x21b4d56138273770 00000100:00080000:1.0:1788846291.977689:0:24983:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788846291.977694:0:24983:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90e3427ce800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846291.977751:0:24983:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e344574a80 x1875740702523776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846291.977784:0:24983:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788846291.977871:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846291.977875:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788846291.977877:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e343be3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846291.977881:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 674 00000100:00080000:1.0:1788846291.977884:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788846291.977888:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90e343be3000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846291.977901:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e344574e00 x1875740702524160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846291.977949:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846291.977951:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788846291.977953:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846291.977957:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 674 00000100:00080000:1.0:1788846291.977959:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788846291.977963:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e458351800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846291.977974:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e344576680 x1875740702524672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846291.978045:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702523904:0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.978134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.978177:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702524544:0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.978210:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.978231:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788846291.978236:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702524416:0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.978256:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.978273:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702525056:0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.978294:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.978323:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702523904 00000100:00100000:1.0:1788846291.978330:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702523904 00000100:00100000:1.0:1788846291.978363:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702524416 00000100:00100000:1.0:1788846291.978366:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702524416 00000100:00100000:1.0:1788846291.978381:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788846291.978389:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702523904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.978440:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702523904:12345-0@lo:400:kworker.0 Request processed in 50us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846291.978453:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788846291.978468:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788846291.978474:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702524416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.978500:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702524416:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846291.978505:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788846291.978564:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702524416:0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.978574:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702523904:0@lo:400:kworker.0 00000100:00100000:0.0:1788846291.979499:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702523776:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788846291.979571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.979665:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702525056 00000100:00100000:1.0:1788846291.979672:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702525056 00000100:00100000:1.0:1788846291.979708:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702523776 00000100:00100000:1.0:1788846291.979711:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702523776 00000100:00100000:1.0:1788846291.979724:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788846291.979731:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702525056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.979775:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702525056:12345-0@lo:400:kworker.0 Request processed in 45us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846291.979781:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788846291.979796:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788846291.979800:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702523776:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788846291.979822:0:22649:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:1.0:1788846291.979864:0:22649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x21b4d56138273777 00000004:00100000:1.0:1788846291.979877:0:22649:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788846291.979906:0:22649:0:(import.c:65:import_set_state_nolock()) ffff90e3429e1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846291.979951:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875740702523776:12345-0@lo:38:llog_process_th.0 Request processed in 148us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846291.979967:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788846291.980015:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e474543480 x1875740702525056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846291.980027:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702525056:0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.982298:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702524288:0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.982362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846291.982730:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702524032:0@lo:400:kworker.0 00000100:00100000:2.0:1788846291.982766:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788846291.984355:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344574a80 x1875740702523776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846291.984370:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788846291.984381:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788846291.984390:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788846291.984396:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788846291.984399:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e3427ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788846291.984406:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702523776:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788846291.984415:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702524160:0@lo:8:kworker.0 00000100:00100000:0.0:1788846291.984467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846291.984495:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702524672:0@lo:8:kworker.0 00000100:00100000:0.0:1788846291.984544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846291.984594:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702524544 00000100:00100000:0.0:1788846291.984600:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702524544 00000100:00100000:0.0:1788846291.984633:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702524032 00000100:00100000:0.0:1788846291.984637:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702524032 00000100:00100000:0.0:1788846291.984647:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702524160 00000100:00100000:0.0:1788846291.984650:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702524160 00000100:00100000:0.0:1788846291.984657:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702524672 00000100:00100000:0.0:1788846291.984659:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702524672 00000100:00100000:0.0:1788846291.984669:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788846291.984679:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702524544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846291.984730:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702524544:12345-0@lo:400:kworker.0 Request processed in 54us (6518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846291.984738:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788846291.984752:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788846291.984759:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702524032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846291.984787:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702524032:12345-0@lo:400:kworker.0 Request processed in 29us (2020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846291.984792:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788846291.984803:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788846291.984807:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875740702524160:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788846291.984866:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875740702524160:12345-0@lo:8:kworker.0 Request processed in 57us (399us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788846291.984873:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788846291.984884:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788846291.984887:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875740702524672:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788846291.984917:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875740702524672:12345-0@lo:8:kworker.0 Request processed in 28us (372us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788846291.984939:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788846291.984959:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702524288 00000100:00100000:0.0:1788846291.984963:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702524288 00000100:00100000:0.0:1788846291.984990:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788846291.985236:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702524288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846291.985271:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702524288:12345-0@lo:400:kworker.0 Request processed in 39us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846291.985278:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788846291.985404:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702524544:0@lo:400:kworker.0 00000100:00100000:0.0:1788846291.985432:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788846291.985437:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343be3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846291.985441:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788846291.985444:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702524160:0@lo:8:kworker.0 00000100:00100000:0.0:1788846291.985452:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788846291.985455:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846291.985458:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788846291.985461:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702524672:0@lo:8:kworker.0 00010000:00080000:1.0:1788846291.989311:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344576a00 x1875740702524288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846291.989331:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702524288:0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.989342:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702524928:0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.989407:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.989478:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702524928 00000100:00100000:1.0:1788846291.989484:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702524928 00000100:00100000:1.0:1788846291.989548:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788846291.989557:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702524928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846291.989608:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702524928:12345-0@lo:400:kworker.0 Request processed in 52us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846291.989615:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788846291.989644:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e448f87480 x1875740702524928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846291.989653:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702524928:0@lo:400:kworker.0 00000020:01000004:1.0:1788846291.989775:0:24983:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788846291.989805:0:24983:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90e343490000) 00000020:00000080:1.0:1788846291.989833:0:24983:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788846291.989931:0:24983:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e34440e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788846291.989935:0:24983:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e34440e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788846291.989938:0:24983:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e34440e000 3 00010000:00080000:1.0:1788846291.989965:0:24983:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e343bde000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1788846291.993476:0:24983:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:2.0:1788846291.993735:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702524032:0@lo:400:kworker.0 00000100:00100000:2.0:1788846291.993748:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702524800:0@lo:400:kworker.0 00000100:00100000:2.0:1788846291.993808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846291.993967:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702524800 00000100:00100000:3.0:1788846291.993974:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702524800 00000100:00100000:3.0:1788846291.994030:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788846291.994038:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702524800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846291.994094:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702524800:12345-0@lo:400:kworker.0 Request processed in 57us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846291.994499:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788846291.994628:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e448f84700 x1875740702524800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846291.994640:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702524800:0@lo:400:kworker.0 00000020:00000080:1.0:1788846291.995916:0:24983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788846291.995962:0:24983:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788846291.995974:0:24983:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x21b4d56138273785 00000100:00080000:1.0:1788846291.995983:0:24983:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788846291.995988:0:24983:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90e343bde000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846291.996356:0:24983:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e474542680 x1875740702525184/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846291.996387:0:24983:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788846291.996590:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702525184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846291.996667:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846291.996756:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702525184 00000100:00100000:1.0:1788846291.996763:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702525184 00000100:00100000:1.0:1788846291.996801:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788846291.996807:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702525184:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788846291.996832:0:22648:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:1.0:1788846291.996881:0:22648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x21b4d5613827378c 00000004:00100000:1.0:1788846291.996896:0:22648:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788846291.996925:0:22648:0:(import.c:65:import_set_state_nolock()) ffff90e343bdb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846291.996975:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875740702525184:12345-0@lo:38:llog_process_th.0 Request processed in 166us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846291.996983:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788846291.997034:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e474542680 x1875740702525184/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846291.997054:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788846291.997061:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788846291.997068:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788846291.997072:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788846291.997074:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343bde000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788846291.997080:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702525184:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788846291.999433:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788846291.999602:0:24970:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788846291.999631:0:24970:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788846291.999654:0:24970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46f358000/0x21b4d5613827375b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273762 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846291.999664:0:24970:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46f358000/0x21b4d5613827375b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273762 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788846291.999723:0:24970:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788846291.999725:0:24970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788846291.999726:0:24970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788846291.999728:0:24970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846291.999733:0:24970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788846291.999735:0:24970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846291.999736:0:24970:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788846291.999737:0:24970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846291.999738:0:24970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788846291.999742:0:24970:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788846291.999744:0:24970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788846291.999746:0:24970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788846291.999746:0:24970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788846291.999747:0:24970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846291.999748:0:24970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788846291.999750:0:24970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846291.999751:0:24970:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788846291.999751:0:24970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846291.999752:0:24970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788846291.999777:0:24970:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788846291.999797:0:24970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702525312:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788846291.999871:0:24970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846291.999899:0:24970:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3444206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846292.000648:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702525312 00000100:00100000:0.0:1788846292.000656:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702525312 00000100:00100000:0.0:1788846292.000701:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788846292.000710:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702525312:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788846292.000736:0:22641:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788846292.000750:0:22641:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788846292.014497:0:22641:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788846292.014514:0:22641:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788846292.014953:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:24970:x1875740702525312:12345-0@lo:253:mount.lustre.0 Request processed in 14240us (15077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846292.014966:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788846292.015138:0:24970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:24970:1875740702525312:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788846292.015316:0:24970:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788846292.015320:0:24970:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788846292.015322:0:24970:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788846292.015323:0:24970:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788846292.015325:0:24970:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846292.015326:0:24970:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788846292.015328:0:24970:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846292.015330:0:24970:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788846292.015331:0:24970:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846292.015333:0:24970:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788846292.015359:0:24970:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788846292.016569:0:22663:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788846292.016575:0:22663:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788846292.016595:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.016612:0:22663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42d000/0x21b4d56138273627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273620 expref: 23 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.016620:0:22663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342aaa800/0x21b4d56138273635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827362e expref: 23 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.016628:0:22663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.016662:0:22663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342aaa800/0x21b4d56138273635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827362e expref: 23 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.016675:0:22663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342aaa800/0x21b4d56138273635 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827362e expref: 23 pid: 22641 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846292.016912:0:22663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702525440:0@lo:104: 00000100:00100000:2.0:1788846292.016966:0:22663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846292.017012:0:22663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42d000/0x21b4d56138273627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138273620 expref: 23 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.017021:0:22663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e46d42d000/0x21b4d56138273627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138273620 expref: 23 pid: 22641 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846292.017029:0:22663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702525568:0@lo:104: 00000100:00100000:2.0:1788846292.017059:0:22663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846292.017080:0:22663:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846292.017288:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702525440 00000100:00100000:3.0:1788846292.017296:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702525440 00000100:00100000:3.0:1788846292.017327:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702525568 00000100:00100000:3.0:1788846292.017330:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702525568 00000100:00100000:3.0:1788846292.017345:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788846292.017354:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:22663:x1875740702525440:12345-0@lo:104: 00010000:00010000:3.0:1788846292.017372:0:22630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846292.017429:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846292.017435:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:22663:x1875740702525440:12345-0@lo:104: Request processed in 82us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846292.017441:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788846292.017458:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788846292.017464:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+3:22663:x1875740702525568:12345-0@lo:104: 00010000:00010000:3.0:1788846292.017471:0:22630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846292.017517:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788846292.017552:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+3:22663:x1875740702525568:12345-0@lo:104: Request processed in 89us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846292.017559:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788846292.017575:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846292.017580:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846292.017587:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d200 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846292.017591:0:23801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846292.017599:0:23801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846292.017606:0:23801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846292.017617:0:23801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788846292.017643:0:23801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846292.017650:0:23801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846292.017669:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846292.017675:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d5613827362e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273635 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846292.018636:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846292.018653:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702525696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846292.018988:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846292.018995:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.019003:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846292.019007:0:22636:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.019015:0:22636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846292.019022:0:22636:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846292.019029:0:22636:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788846292.019065:0:22636:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.019071:0:22636:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846292.019089:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.019095:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138273620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273627 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846292.019270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846292.019326:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846292.019335:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702525824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846292.019361:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846292.019394:0:23802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702525696 00000100:00100000:1.0:1788846292.019400:0:23802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702525696 00010000:00010000:1.0:1788846292.019425:0:23802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342aaa800/0x21b4d56138273635 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827362e expref: 24 pid: 22641 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846292.019448:0:23802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702525824 00000100:00100000:1.0:1788846292.019450:0:23802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702525824 00010000:00010000:1.0:1788846292.019460:0:23802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42d000/0x21b4d56138273627 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273620 expref: 25 pid: 22641 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846292.019477:0:23802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788846292.019484:0:23802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474542680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+25:3642:x1875740702525696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846292.019494:0:23802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846292.019508:0:23802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342aaa800/0x21b4d56138273635 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827362e expref: 25 pid: 22641 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.019543:0:23802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342aaa800/0x21b4d56138273635 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827362e expref: 25 pid: 22641 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.019560:0:23802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846292.019593:0:23802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474542680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+25:3642:x1875740702525696:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846292.019600:0:23802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788846292.019615:0:23802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788846292.019621:0:23802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3641:x1875740702525824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846292.019628:0:23802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846292.019632:0:23802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42d000/0x21b4d56138273627 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273620 expref: 24 pid: 22641 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.019640:0:23802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42d000/0x21b4d56138273627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138273620 expref: 24 pid: 22641 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.019651:0:23802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.019659:0:23802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788846292.019674:0:23802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014338913s 00010000:00010000:2.0:1788846292.020055:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846292.020058:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846292.020060:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846292.020092:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aaa800/0x21b4d56138273635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827362e expref: 24 pid: 22641 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846292.020803:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846292.020806:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846292.020808:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846292.020945:0:22663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702525440:0@lo:104: 00010000:00010000:2.0:1788846292.020964:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42d000/0x21b4d56138273627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138273620 expref: 23 pid: 22641 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846292.020972:0:22663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22663:1875740702525568:0@lo:104: 00010000:00010000:2.0:1788846292.020993:0:22663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.021003:0:22663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846292.021009:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.021110:0:23802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.021125:0:23802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.021143:0:23802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.021159:0:23802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.021165:0:23802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aabe00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846292.021169:0:23802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.021177:0:23802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.021198:0:23802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.021206:0:23802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aabe00/0x21b4d56138273793 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846292.021220:0:23802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846292.021284:0:23802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:3641:x1875740702525824:12345-0@lo:103:ldlm_bl.0 Request processed in 1662us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846292.021292:0:23802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788846292.021344:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702525696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846292.021587:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702525824:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788846292.022760:0:24970:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788846292.026556:0:24970:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788846292.026566:0:24970:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788846292.026616:0:24970:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788846292.026659:0:24970:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788846292.026679:0:24970:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788846292.026709:0:24970:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788846292.027704:0:24970:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788846292.031094:0:24970:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788846292.857721:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788846293.034210:0:25037:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788846293.034491:0:25037:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788846293.113646:0:22644:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788846293.113653:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e47b586000 from 14 10000000:01000000:0.0:1788846293.113659:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788846293.113703:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4752f2600/0x21b4d5613827379a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846293.113714:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e4752f2600/0x21b4d5613827379a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846293.113726:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e4752f2600/0x21b4d5613827379a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846293.113751:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702525952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846293.113824:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846293.113877:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4484ea600 going to sleep for 11 seconds 00000100:00100000:1.0:1788846293.114564:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702525952 00000100:00100000:1.0:1788846293.114573:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702525952 00000100:00100000:1.0:1788846293.114643:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788846293.114652:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:22644:x1875740702525952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846293.114665:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846293.114680:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46f358e00/0x21b4d561382737a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827379a expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846293.114704:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46f358e00/0x21b4d561382737a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827379a expref: 23 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846293.114714:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46f358e00/0x21b4d561382737a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827379a expref: 23 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846293.114722:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f358e00, rc 0) 00000100:00100000:1.0:1788846293.114768:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:22644:x1875740702525952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846293.114775:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788846293.115275:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702525952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846293.115291:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e4752f2600/0x21b4d5613827379a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382737a1 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846293.115301:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e4752f2600/0x21b4d5613827379a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382737a1 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846293.115361:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702526080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788846293.115398:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846293.115440:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4484ea600 going to sleep for 11 seconds 00000100:00100000:1.0:1788846293.115486:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702526080 00000100:00100000:1.0:1788846293.115491:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702526080 00000100:00100000:1.0:1788846293.115585:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788846293.115593:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:22644:x1875740702526080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788846293.115705:0:22641:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788846293.115722:0:22641:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788846293.115724:0:22641:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788846293.115811:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:22644:x1875740702526080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 219us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846293.115826:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788846293.116107:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702526080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788846293.116170:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788846293.116186:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4752f2600/0x21b4d5613827379a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382737a1 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846293.116195:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e4752f2600/0x21b4d5613827379a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382737a1 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846293.116203:0:22644:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788846293.116205:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e474598800 from 14 10000000:01000000:0.0:1788846293.116208:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788846293.116227:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4752f2e00/0x21b4d561382737a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846293.116283:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e4752f2e00/0x21b4d561382737a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846293.116291:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e4752f2e00/0x21b4d561382737a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846293.116305:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702526208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846293.116332:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846293.118482:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4484ea600 going to sleep for 11 seconds 00000100:00100000:0.0:1788846293.120838:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702526208 00000100:00100000:0.0:1788846293.120861:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702526208 00000100:00100000:0.0:1788846293.120911:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788846293.120921:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:22644:x1875740702526208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846293.120936:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846293.120968:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4752f3200/0x21b4d561382737af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382737a8 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846293.120999:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4752f3200/0x21b4d561382737af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382737a8 expref: 24 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846293.121010:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4752f3200/0x21b4d561382737af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382737a8 expref: 24 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846293.121019:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f3200, rc 0) 00000100:00100000:0.0:1788846293.121103:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:22644:x1875740702526208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (4770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846293.121110:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788846293.121205:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702526208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846293.121223:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e4752f2e00/0x21b4d561382737a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382737af expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846293.121233:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e4752f2e00/0x21b4d561382737a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382737af expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846293.121296:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702526336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788846293.121339:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846293.121376:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342a0b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788846293.121422:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702526336 00000100:00100000:0.0:1788846293.121426:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702526336 00000100:00100000:0.0:1788846293.121445:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788846293.121450:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:22644:x1875740702526336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788846293.121463:0:22641:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788846293.121478:0:22641:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788846293.121481:0:22641:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788846293.121591:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:22644:x1875740702526336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846293.121672:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788846293.121745:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702526336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788846293.121804:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788846293.121811:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4752f2e00/0x21b4d561382737a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382737af expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846293.121820:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e4752f2e00/0x21b4d561382737a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382737af expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846293.824636:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788846293.824659:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702526464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788846293.824720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846293.824770:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702526464 00000100:00100000:0.0:1788846293.824779:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702526464 00000100:00100000:0.0:1788846293.824830:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788846293.824848:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702526464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788846293.824875:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788846293.824912:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702526464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846293.824919:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788846293.824940:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846293.824979:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702526464:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788846293.881699:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846294.340331:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788846294.340357:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702526592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846294.340431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846294.340577:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846294.340587:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702526720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788846294.340618:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846294.340648:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702526592 00000100:00100000:1.0:1788846294.340655:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702526592 00000100:00100000:1.0:1788846294.340704:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702526720 00000100:00100000:1.0:1788846294.340709:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702526720 00000100:00100000:1.0:1788846294.340726:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788846294.340748:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702526592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788846294.340783:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788846294.340823:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702526592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846294.340831:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788846294.340846:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788846294.340852:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702526720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846294.340868:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846294.340899:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702526720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846294.340905:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788846294.340943:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702526720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788846294.341029:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702526592:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788846294.907626:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846295.865945:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846295.865969:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702526848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788846295.866034:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846295.866167:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702526848 00000100:00100000:0.0:1788846295.866176:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702526848 00000100:00100000:0.0:1788846295.866250:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788846295.866260:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702526848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788846295.866287:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788846295.866331:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702526848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846295.866338:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788846295.866434:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846295.866470:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702526848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788846295.930022:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846296.953788:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788846297.401737:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846297.401743:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788846297.401747:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e343be3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846297.401758:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90e343be3000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846297.401780:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b0a80 x1875740702527360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788846297.401811:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846297.401814:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788846297.401816:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846297.401820:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e458351800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846297.401830:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b1c00 x1875740702527872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846297.401891:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702527488:0@lo:400:kworker.0 00000100:00100000:3.0:1788846297.401954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846297.402062:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702526976:0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.402099:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846297.402156:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702527616:0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.402184:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846297.402203:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702528256:0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.402229:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702527104:0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.402261:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846297.402279:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702527744:0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.402302:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846297.402320:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702528384:0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.402362:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702527360:0@lo:8:kworker.0 00000100:00100000:1.0:1788846297.402383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846297.402400:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702527872:0@lo:8:kworker.0 00000100:00100000:1.0:1788846297.402431:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846297.402675:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702526976 00000100:00100000:1.0:1788846297.402684:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702526976 00000100:00100000:1.0:1788846297.402730:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788846297.402738:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3641:x1875740702526976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.402787:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3641:x1875740702526976:12345-0@lo:400:kworker.0 Request processed in 49us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846297.402794:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788846297.402825:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702527616 00000100:00100000:1.0:1788846297.402829:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702527616 00000100:00100000:1.0:1788846297.402845:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702527104 00000100:00100000:1.0:1788846297.402848:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702527104 00000100:00100000:1.0:1788846297.402861:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788846297.402867:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702527616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.402900:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702527616:12345-0@lo:400:kworker.0 Request processed in 33us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846297.402906:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788846297.402918:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788846297.402924:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702527104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.403049:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702527104:12345-0@lo:400:kworker.0 Request processed in 123us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846297.403055:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788846297.403078:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702527744 00000100:00100000:1.0:1788846297.403081:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702527744 00000100:00100000:1.0:1788846297.403111:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702527360 00000100:00100000:1.0:1788846297.403114:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702527360 00000100:00100000:1.0:1788846297.403122:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702527872 00000100:00100000:1.0:1788846297.403124:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702527872 00000100:00100000:1.0:1788846297.403134:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788846297.403140:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702527744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.403182:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702527744:12345-0@lo:400:kworker.0 Request processed in 42us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846297.403188:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788846297.403200:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788846297.403204:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875740702527360:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788846297.403229:0:24156:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:1.0:1788846297.403259:0:24156:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d561382737b6 00002000:00100000:1.0:1788846297.403274:0:24156:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90e343bdc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788846297.403278:0:24156:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788846297.403282:0:24156:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788846297.403676:0:24156:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788846297.403700:0:24156:0:(import.c:65:import_set_state_nolock()) ffff90e343bdf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846297.403742:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1875740702527360:12345-0@lo:8:kworker.0 Request processed in 536us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846297.403750:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788846297.403763:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788846297.403777:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875740702527872:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788846297.403795:0:24156:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:1.0:1788846297.403812:0:24156:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d561382737bd 00002000:00100000:1.0:1788846297.403819:0:24156:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90e343bda000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788846297.403823:0:24156:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788846297.403824:0:24156:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788846297.403846:0:24156:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788846297.403858:0:24156:0:(import.c:65:import_set_state_nolock()) ffff90e343bdd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846297.403886:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3639:x1875740702527872:12345-0@lo:8:kworker.0 Request processed in 109us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846297.403892:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788846297.403924:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846297.404088:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702528128:0@lo:400:kworker.0 00000100:00100000:3.0:1788846297.404121:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846297.404164:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702527232:0@lo:400:kworker.0 00000100:00100000:3.0:1788846297.404192:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846297.404210:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702528000:0@lo:400:kworker.0 00000100:00100000:3.0:1788846297.404230:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846297.404248:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702528512:0@lo:400:kworker.0 00000100:00100000:3.0:1788846297.404270:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846297.404295:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702527488 00000100:00100000:3.0:1788846297.404299:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702527488 00000100:00100000:3.0:1788846297.404323:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702528128 00000100:00100000:3.0:1788846297.404325:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702528128 00010000:00080000:1.0:1788846297.405058:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b0a80 x1875740702527360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788846322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788846297.405080:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788846297.405090:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788846297.405096:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788846297.405099:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343be3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788846297.405114:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788846297.405122:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702527360:0@lo:8:kworker.0 00010000:00080000:1.0:1788846297.405155:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1c00 x1875740702527872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788846322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788846297.405164:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788846297.405170:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788846297.405172:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788846297.405175:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e458351800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788846297.405198:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788846297.405202:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702527872:0@lo:8:kworker.0 00000004:00080000:1.0:1788846297.405260:0:22674:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788846297.405280:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22674:1875740702528768:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788846297.405317:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846297.405588:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702528000 00000100:00100000:3.0:1788846297.405593:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702528000 00000100:00100000:3.0:1788846297.405606:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702528512 00000100:00100000:3.0:1788846297.405608:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702528512 00000100:00100000:3.0:1788846297.405628:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788846297.405636:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702527488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846297.405682:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702527488:12345-0@lo:400:kworker.0 Request processed in 47us (3727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846297.405688:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788846297.405702:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788846297.405707:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702528128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846297.405743:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702528128:12345-0@lo:400:kworker.0 Request processed in 35us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846297.405749:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788846297.405762:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788846297.405767:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702528000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846297.405798:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702528000:12345-0@lo:400:kworker.0 Request processed in 30us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846297.405804:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788846297.405815:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788846297.405821:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702528512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846297.405845:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702528512:12345-0@lo:400:kworker.0 Request processed in 26us (1574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846297.405850:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000004:00080000:3.0:1788846297.405884:0:23391:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788846297.405898:0:23391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23391:1875740702529024:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788846297.405924:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846297.405945:0:23391:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f1840 going to sleep for 11 seconds 00000100:00100000:1.0:1788846297.406062:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342a0b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788846297.406078:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702527232 00000100:00100000:1.0:1788846297.406082:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702527232 00000100:00100000:1.0:1788846297.406111:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702528768 00000100:00100000:1.0:1788846297.406114:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702528768 00000100:00100000:1.0:1788846297.406125:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702529024 00000100:00100000:1.0:1788846297.406127:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702529024 00000100:00100000:1.0:1788846297.406140:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788846297.406156:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702527232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.406191:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702527232:12345-0@lo:400:kworker.0 Request processed in 36us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846297.406197:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788846297.406208:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788846297.406214:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22674:x1875740702528768:12345-0@lo:5:osp-pre-1-0.0 00000040:00080000:0.0:1788846297.406736:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00080000:0.0:1788846297.406808:0:22673:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788846297.406883:0:22673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681444362336ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788846297.406890:0:22673:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788846297.407171:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788846297.407183:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23391:x1875740702529024:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:1.0:1788846297.407223:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788846297.407227:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788846297.407231:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788846297.407233:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846297.407248:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846297.407606:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702527104:0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.407632:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702527744:0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.407660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846297.407689:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702528896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788846297.407729:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846297.407755:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702526976:0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.407766:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702527616:0@lo:400:kworker.0 00000100:00100000:1.0:1788846297.407778:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846297.407784:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702528640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846297.407804:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846297.407834:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702528896 00000100:00100000:1.0:1788846297.407839:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702528896 00000100:00100000:1.0:1788846297.407866:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702528640 00000100:00100000:1.0:1788846297.407868:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702528640 00000100:00100000:1.0:1788846297.407880:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788846297.407887:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1875740702528896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788846297.407908:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788846297.407947:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1875740702528896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846297.407954:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788846297.408648:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788846297.408657:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875740702528640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788846297.408670:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788846297.408704:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875740702528640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846297.408710:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788846297.408753:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1180 x1875740702527488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846297.408765:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702527488:0@lo:400:kworker.0 00010000:00080000:1.0:1788846297.408777:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b0000 x1875740702528128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846297.408785:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702528128:0@lo:400:kworker.0 00010000:00080000:1.0:1788846297.408811:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e344575f80 x1875740702528640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846297.408823:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702528640:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788846297.408832:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439e7100 x1875740702528896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846297.408842:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702528896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788846297.410369:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702527232:0@lo:400:kworker.0 00010000:00080000:1.0:1788846297.410389:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b3800 x1875740702528000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846297.410399:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702528000:0@lo:400:kworker.0 00010000:00080000:1.0:1788846297.410420:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1500 x1875740702528512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846297.410428:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702528512:0@lo:400:kworker.0 00000004:00080000:3.0:1788846297.410698:0:23390:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788846297.410798:0:23390:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 681448277242ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788846297.410806:0:23390:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788846297.410833:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702528384 00000100:00100000:3.0:1788846297.410840:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702528384 00000100:00100000:3.0:1788846297.410887:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702528256 00000100:00100000:3.0:1788846297.410890:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702528256 00000100:00100000:3.0:1788846297.410907:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788846297.410914:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702528384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846297.412133:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702528384:12345-0@lo:400:kworker.0 Request processed in 1213us (4879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846297.412152:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788846297.412177:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788846297.412187:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702528256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846297.412226:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702528256:12345-0@lo:400:kworker.0 Request processed in 42us (4565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846297.412232:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788846297.412258:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788846297.412262:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788846297.415619:0:23380:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00080000:1.0:1788846297.415691:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1f80 x1875740702528384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846297.415721:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702528384:0@lo:400:kworker.0 00010000:00080000:1.0:1788846297.415765:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b2a00 x1875740702528256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846297.415775:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702528256:0@lo:400:kworker.0 00000004:00080000:2.0:1788846297.416590:0:22627:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788846297.418317:0:24154:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788846297.418325:0:24154:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00002000:00080000:1.0:1788846297.418666:0:24581:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788846297.418673:0:24581:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1788846297.418680:0:24581:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00000100:00100000:2.0:1788846297.424228:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23391:x1875740702529024:12345-0@lo:7:osp-pre-1-1.0 Request processed in 17038us (18292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846297.424263:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788846297.427204:0:23391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439e5880 x1875740702529024/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788846313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846297.427227:0:23391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23391:1875740702529024:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788846297.427248:0:23391:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788846297.427664:0:23391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23391:1875740702529152:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788846297.427741:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846297.427778:0:23391:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442b91cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846297.427824:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702529152 00000100:00100000:3.0:1788846297.427838:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702529152 00000100:00100000:3.0:1788846297.428323:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788846297.428333:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23391:x1875740702529152:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788846297.428361:0:24155:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788846297.428656:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23391:x1875740702529152:12345-0@lo:5:osp-pre-1-1.0 Request processed in 323us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846297.428664:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788846297.428713:0:23391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439e5880 x1875740702529152/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788846313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846297.428738:0:23391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23391:1875740702529152:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788846297.428749:0:23391:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788846297.428782:0:23391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23391:1875740702529280:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788846297.428823:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846297.429368:0:23391:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442b91cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846297.429628:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702529280 00000100:00100000:3.0:1788846297.429634:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702529280 00000100:00100000:3.0:1788846297.429669:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788846297.429689:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23391:x1875740702529280:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788846297.429723:0:24154:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:1.0:1788846297.443026:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.443039:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d561382737c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.443055:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.443060:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.443066:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d561382737c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.443082:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d561382737c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.443092:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d561382737c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.443100:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d561382737c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.443155:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846297.443509:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846297.443516:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d561382737c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.443558:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.443562:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d561382737c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.443571:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d561382737c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.443588:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d561382737c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.443595:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d561382737c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.443616:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.443617:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.443619:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846297.444784:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.444793:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d561382737cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.444806:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.444810:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.444815:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d561382737cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.444827:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d561382737cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.444836:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d561382737cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.444844:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d561382737cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.444945:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788846297.445978:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846297.445989:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022c41963/0x21b4d561382737d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.446002:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788846297.446006:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846297.446011:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022c41963/0x21b4d561382737d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.446023:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022c41963/0x21b4d561382737d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.446032:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022c41963/0x21b4d561382737d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.446053:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022c41963/0x21b4d561382737d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.451015:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846297.451032:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d561382737cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.451047:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.451052:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d561382737cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.451075:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d561382737cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.451097:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d561382737cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.451105:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d561382737cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.451237:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846297.451241:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022c41963/0x21b4d561382737d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.451248:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.451252:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022c41963/0x21b4d561382737d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.451261:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022c41963/0x21b4d561382737d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.451271:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022c41963/0x21b4d561382737d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.451277:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.451279:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.451286:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846297.453776:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788846297.453787:0:24581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022c41963/0x21b4d561382737d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.453869:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846297.454871:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846297.454880:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3ff6079/0x21b4d561382737d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.454894:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788846297.454899:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846297.454905:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ff6079/0x21b4d561382737d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.454918:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3ff6079/0x21b4d561382737d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.454927:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3ff6079/0x21b4d561382737d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.454934:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3ff6079/0x21b4d561382737d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.455189:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846297.455563:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846297.455570:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3ff6079/0x21b4d561382737d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.455580:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42de00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.455585:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3ff6079/0x21b4d561382737d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.455594:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3ff6079/0x21b4d561382737d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.455611:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3ff6079/0x21b4d561382737d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.455618:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3ff6079/0x21b4d561382737d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.455636:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.455638:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.455639:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846297.456138:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846297.456156:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc44367/0x21b4d561382737e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.456167:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788846297.456171:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846297.456176:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abc44367/0x21b4d561382737e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.456186:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abc44367/0x21b4d561382737e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.456195:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc44367/0x21b4d561382737e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.456203:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abc44367/0x21b4d561382737e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.456227:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846297.456550:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846297.456557:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abc44367/0x21b4d561382737e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.456565:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.456569:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc44367/0x21b4d561382737e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.456585:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc44367/0x21b4d561382737e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.456599:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abc44367/0x21b4d561382737e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.456606:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abc44367/0x21b4d561382737e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.456621:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.456623:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.456625:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846297.458156:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846297.458166:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228826f9/0x21b4d561382737e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.458180:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788846297.458194:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846297.458201:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000228826f9/0x21b4d561382737e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.458225:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000228826f9/0x21b4d561382737e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.458234:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228826f9/0x21b4d561382737e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.458241:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000228826f9/0x21b4d561382737e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.458260:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846297.459358:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846297.459371:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000228826f9/0x21b4d561382737e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.459382:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.459387:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000228826f9/0x21b4d561382737e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.459395:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000228826f9/0x21b4d561382737e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.459560:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000228826f9/0x21b4d561382737e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.459582:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000228826f9/0x21b4d561382737e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.459608:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.459610:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.459612:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846297.460585:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846297.460595:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d561382737ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.460609:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788846297.460613:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846297.460619:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d561382737ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.460630:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d561382737ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.460639:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d561382737ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.460654:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d561382737ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.460674:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788846297.462172:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846297.462183:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022d7d467/0x21b4d561382737f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.462197:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1788846297.462200:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846297.462205:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022d7d467/0x21b4d561382737f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.462216:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022d7d467/0x21b4d561382737f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.462225:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022d7d467/0x21b4d561382737f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.462233:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022d7d467/0x21b4d561382737f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.462252:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788846297.462464:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846297.462471:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d561382737ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.462479:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.462483:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d561382737ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.462492:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d561382737ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.462509:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d561382737ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.462517:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d561382737ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.462552:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846297.462556:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022d7d467/0x21b4d561382737f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.462571:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.462575:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022d7d467/0x21b4d561382737f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.462583:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022d7d467/0x21b4d561382737f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.462594:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022d7d467/0x21b4d561382737f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.462601:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022d7d467/0x21b4d561382737f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.462614:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.462616:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.462618:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.462638:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846297.464784:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846297.464795:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad6ad7f9/0x21b4d561382737fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.464810:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788846297.464814:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846297.464821:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad6ad7f9/0x21b4d561382737fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.464846:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad6ad7f9/0x21b4d561382737fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.464856:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad6ad7f9/0x21b4d561382737fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.464863:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad6ad7f9/0x21b4d561382737fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.464880:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846297.464891:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846297.464896:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad6ad7f9/0x21b4d561382737fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.464903:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaac00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.464908:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad6ad7f9/0x21b4d561382737fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.464917:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad6ad7f9/0x21b4d561382737fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.464932:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad6ad7f9/0x21b4d561382737fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.464939:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad6ad7f9/0x21b4d561382737fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.466149:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.466153:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.466155:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846297.467516:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846297.467542:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0eecf5/0x21b4d56138273803 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.467560:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788846297.467566:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846297.467572:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0eecf5/0x21b4d56138273803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.467585:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0eecf5/0x21b4d56138273803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.467595:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0eecf5/0x21b4d56138273803 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.467603:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0eecf5/0x21b4d56138273803 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.467620:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846297.467630:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846297.467635:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0eecf5/0x21b4d56138273803 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.467655:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aabc00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.467662:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0eecf5/0x21b4d56138273803 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.467670:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0eecf5/0x21b4d56138273803 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.467685:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0eecf5/0x21b4d56138273803 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.467693:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0eecf5/0x21b4d56138273803 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.467712:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.467713:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.467715:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846297.471554:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846297.471569:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea078e5b/0x21b4d5613827380a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.471587:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788846297.471592:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846297.471597:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea078e5b/0x21b4d5613827380a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.471611:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea078e5b/0x21b4d5613827380a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.471631:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea078e5b/0x21b4d5613827380a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.471638:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea078e5b/0x21b4d5613827380a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.471656:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846297.472138:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846297.472155:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea078e5b/0x21b4d5613827380a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.472165:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846297.472175:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea078e5b/0x21b4d5613827380a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.472185:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea078e5b/0x21b4d5613827380a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.472202:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea078e5b/0x21b4d5613827380a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.472209:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea078e5b/0x21b4d5613827380a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.472229:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846297.472231:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846297.472233:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846297.473161:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846297.473170:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e0d8864/0x21b4d56138273811 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.473182:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1788846297.473186:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846297.473191:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e0d8864/0x21b4d56138273811 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.473201:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e0d8864/0x21b4d56138273811 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.473210:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e0d8864/0x21b4d56138273811 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.473217:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e0d8864/0x21b4d56138273811 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.473244:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846297.473559:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846297.473567:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e0d8864/0x21b4d56138273811 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.473576:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaae00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846297.473580:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e0d8864/0x21b4d56138273811 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.473588:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e0d8864/0x21b4d56138273811 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.473602:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e0d8864/0x21b4d56138273811 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.473615:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e0d8864/0x21b4d56138273811 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.473635:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846297.473637:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846297.473638:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788846297.474865:0:24971:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1788846297.474894:0:24971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788846297.474898:0:24971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788846297.475839:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23391:x1875740702529280:12345-0@lo:5:osp-pre-1-1.0 Request processed in 46145us (47008us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788846297.475850:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788846297.476537:0:23391:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788846297.476548:0:23391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23391:1875740702529280:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788846297.476572:0:23391:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788846297.476622:0:23391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23391:1875740702529408:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788846297.476661:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846297.476684:0:23391:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e34278d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788846297.476706:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702529408 00000100:00100000:3.0:1788846297.476712:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702529408 00000100:00100000:3.0:1788846297.476754:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846297.476762:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23391:x1875740702529408:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788846297.476806:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23391:x1875740702529408:12345-0@lo:900:osp-pre-1-1.0 Request processed in 44us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846297.476813:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788846297.476839:0:23391:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439e5880 x1875740702529408/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788846313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846297.476850:0:23391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23391:1875740702529408:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788846297.477481:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846297.477490:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d56138273818 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.477507:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1788846297.477512:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846297.477532:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d56138273818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.477564:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d56138273818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.477575:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d56138273818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.477583:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d56138273818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.477609:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846297.478088:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846297.478095:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d56138273818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.478105:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846297.478109:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d56138273818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.478181:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d56138273818 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.478210:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d56138273818 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.478216:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d56138273818 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.478235:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846297.478236:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846297.478238:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846297.479099:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.479108:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2bbf9d9/0x21b4d5613827381f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.479251:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.479256:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.479262:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2bbf9d9/0x21b4d5613827381f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.479274:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2bbf9d9/0x21b4d5613827381f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.479283:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2bbf9d9/0x21b4d5613827381f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.479290:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2bbf9d9/0x21b4d5613827381f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.479437:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788846297.480255:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.480263:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273826 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.480275:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.480278:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.480283:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.480292:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.480300:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.480307:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.480579:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788846297.480586:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2bbf9d9/0x21b4d5613827381f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.480594:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846297.480598:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2bbf9d9/0x21b4d5613827381f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.480606:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2bbf9d9/0x21b4d5613827381f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.480622:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2bbf9d9/0x21b4d5613827381f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.480629:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2bbf9d9/0x21b4d5613827381f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.480656:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846297.480660:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273826 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.480666:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846297.480669:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273826 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.480677:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273826 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.480687:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273826 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.480695:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.480697:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.480698:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846297.480935:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788846297.480940:0:24581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273826 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.481306:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846297.481397:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.481551:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a49568b1/0x21b4d5613827382d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.481570:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.481574:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.481579:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a49568b1/0x21b4d5613827382d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.481590:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a49568b1/0x21b4d5613827382d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.481598:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a49568b1/0x21b4d5613827382d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.481605:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a49568b1/0x21b4d5613827382d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.481620:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788846297.481915:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.481922:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d56138273834 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.481931:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.481934:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.481938:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d56138273834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.481947:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d56138273834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.482033:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d56138273834 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.482041:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d56138273834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.482057:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788846297.482491:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.482497:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d5613827383b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.482507:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.482511:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.482515:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d5613827383b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.482544:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d5613827383b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.482552:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d5613827383b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.482559:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d5613827383b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.482585:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788846297.482841:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788846297.482849:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a49568b1/0x21b4d5613827382d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.482857:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846297.482861:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a49568b1/0x21b4d5613827382d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.482881:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a49568b1/0x21b4d5613827382d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.482897:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a49568b1/0x21b4d5613827382d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.482905:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a49568b1/0x21b4d5613827382d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.482922:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788846297.482926:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d56138273834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.482931:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846297.482933:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d56138273834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.482940:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d56138273834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.482949:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d56138273834 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.482965:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006716d17e/0x21b4d56138273834 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.482992:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846297.482996:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d5613827383b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.483002:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846297.483005:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d5613827383b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.483012:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d5613827383b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.483023:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d5613827383b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.483030:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063ba30a8/0x21b4d5613827383b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.483040:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.483041:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.483043:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.483051:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846297.483306:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.483313:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d77a07/0x21b4d56138273842 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.483322:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.483325:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.483329:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d77a07/0x21b4d56138273842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.483474:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3d77a07/0x21b4d56138273842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.483482:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d77a07/0x21b4d56138273842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.483489:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d77a07/0x21b4d56138273842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.483511:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846297.483810:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846297.483817:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3d77a07/0x21b4d56138273842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.483826:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846297.483830:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d77a07/0x21b4d56138273842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.483838:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d77a07/0x21b4d56138273842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.483850:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3d77a07/0x21b4d56138273842 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.483859:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3d77a07/0x21b4d56138273842 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.483886:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846297.483888:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846297.483890:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846297.484077:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.484083:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022d898ca/0x21b4d56138273849 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.484093:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.484103:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.484107:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022d898ca/0x21b4d56138273849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.484186:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022d898ca/0x21b4d56138273849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.484194:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022d898ca/0x21b4d56138273849 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.484203:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022d898ca/0x21b4d56138273849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.484225:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846297.484609:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846297.484614:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022d898ca/0x21b4d56138273849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.484622:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846297.484626:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022d898ca/0x21b4d56138273849 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.484633:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022d898ca/0x21b4d56138273849 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.484645:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022d898ca/0x21b4d56138273849 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.484652:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022d898ca/0x21b4d56138273849 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.484668:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846297.484670:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846297.484672:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846297.484779:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.484785:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddb2dd7a/0x21b4d56138273850 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.484859:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.484862:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.484867:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb2dd7a/0x21b4d56138273850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.484877:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddb2dd7a/0x21b4d56138273850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.484884:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddb2dd7a/0x21b4d56138273850 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.484898:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb2dd7a/0x21b4d56138273850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.484997:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788846297.489540:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.489554:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af550c03/0x21b4d56138273857 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.489572:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.489577:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.489583:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af550c03/0x21b4d56138273857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.489598:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af550c03/0x21b4d56138273857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.489610:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af550c03/0x21b4d56138273857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.489617:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af550c03/0x21b4d56138273857 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.490078:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846297.490087:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddb2dd7a/0x21b4d56138273850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.491865:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846297.491880:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddb2dd7a/0x21b4d56138273850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.491896:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddb2dd7a/0x21b4d56138273850 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.491918:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddb2dd7a/0x21b4d56138273850 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.491925:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddb2dd7a/0x21b4d56138273850 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.491953:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846297.492040:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af550c03/0x21b4d56138273857 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.492048:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846297.492051:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af550c03/0x21b4d56138273857 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.492058:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af550c03/0x21b4d56138273857 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.492068:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af550c03/0x21b4d56138273857 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.492085:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846297.492086:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846297.492089:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.492166:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846297.494138:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788846297.494160:0:24581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af550c03/0x21b4d56138273857 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788846297.498329:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846297.498355:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d5613827385e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.498388:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1788846297.498393:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846297.498401:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d5613827385e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.498417:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d5613827385e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.498429:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d5613827385e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.498438:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d5613827385e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.501327:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846297.502270:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d5613827385e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.502287:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846297.502292:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d5613827385e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.502304:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d5613827385e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.502327:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d5613827385e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.502410:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846297.502413:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846297.502415:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.502775:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788846297.502783:0:24581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d5613827385e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.502866:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846297.503678:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.503688:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273865 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.503702:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.503707:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.503714:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.503727:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.503737:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.503745:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.503803:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788846297.504219:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846297.504225:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2417e59/0x21b4d5613827386c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.504235:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1788846297.504238:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846297.504249:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2417e59/0x21b4d5613827386c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.504259:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2417e59/0x21b4d5613827386c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.504267:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2417e59/0x21b4d5613827386c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846297.504274:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2417e59/0x21b4d5613827386c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.504307:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788846297.504314:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.504322:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846297.504327:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.507100:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273865 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.507135:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273865 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.507164:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea9441d/0x21b4d56138273865 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.507195:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846297.507201:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2417e59/0x21b4d5613827386c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.507208:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846297.507213:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2417e59/0x21b4d5613827386c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.507220:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2417e59/0x21b4d5613827386c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.507230:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2417e59/0x21b4d5613827386c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.507237:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.507239:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.507248:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846297.508822:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788846297.508838:0:24581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2417e59/0x21b4d5613827386c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788846297.511301:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846297.511317:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f64ad8cb/0x21b4d56138273873 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.511349:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1788846297.511355:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846297.511361:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f64ad8cb/0x21b4d56138273873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.511376:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f64ad8cb/0x21b4d56138273873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.511387:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f64ad8cb/0x21b4d56138273873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.511394:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f64ad8cb/0x21b4d56138273873 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.516341:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846297.516356:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f64ad8cb/0x21b4d56138273873 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.516369:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f2a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846297.516385:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f64ad8cb/0x21b4d56138273873 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.516397:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f64ad8cb/0x21b4d56138273873 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846297.516418:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f64ad8cb/0x21b4d56138273873 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.519168:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788846297.519183:0:24581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f64ad8cb/0x21b4d56138273873 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.519220:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.519223:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.519224:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.519549:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846297.519991:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846297.520000:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d5613827387a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.520020:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1788846297.520025:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846297.520031:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d5613827387a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.520045:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d5613827387a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.520055:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d5613827387a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.520063:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d5613827387a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.520123:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788846297.520548:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846297.520555:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000346d1263/0x21b4d56138273881 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.520564:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1788846297.520567:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846297.520571:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000346d1263/0x21b4d56138273881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.520580:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000346d1263/0x21b4d56138273881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.520601:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000346d1263/0x21b4d56138273881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.520608:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000346d1263/0x21b4d56138273881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.524084:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846297.524099:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d5613827387a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.524126:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.524131:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d5613827387a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.524150:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d5613827387a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.524171:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d5613827387a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.524178:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009984e702/0x21b4d5613827387a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.524204:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846297.524207:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000346d1263/0x21b4d56138273881 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.524230:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.524233:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000346d1263/0x21b4d56138273881 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.524240:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000346d1263/0x21b4d56138273881 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.524250:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000346d1263/0x21b4d56138273881 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.524258:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.524259:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.524261:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.529549:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788846297.529563:0:24581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000346d1263/0x21b4d56138273881 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.530240:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846297.531462:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846297.531474:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d56138273888 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.531492:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1788846297.531496:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846297.531502:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d56138273888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.531517:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d56138273888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.531547:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d56138273888 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.531567:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d56138273888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.531587:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846297.532666:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846297.532675:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d56138273888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.532687:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846297.532692:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d56138273888 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.532702:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d56138273888 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.532723:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d56138273888 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.532738:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4c6a3de/0x21b4d56138273888 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846297.532758:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.532760:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846297.532761:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846297.533359:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846297.533368:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c219516/0x21b4d5613827388f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.533380:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1788846297.533384:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846297.533390:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c219516/0x21b4d5613827388f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.533401:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c219516/0x21b4d5613827388f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.533410:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c219516/0x21b4d5613827388f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.533418:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c219516/0x21b4d5613827388f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.533436:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846297.533445:0:22635:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846297.533450:0:22635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c219516/0x21b4d5613827388f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.533464:0:22635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846297.533468:0:22635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c219516/0x21b4d5613827388f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.533475:0:22635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c219516/0x21b4d5613827388f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.533487:0:22635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c219516/0x21b4d5613827388f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.533494:0:22635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c219516/0x21b4d5613827388f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.533508:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.533510:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.533511:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846297.540209:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846297.540222:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000affdc66f/0x21b4d56138273896 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540241:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1788846297.540245:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846297.540251:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000affdc66f/0x21b4d56138273896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540265:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000affdc66f/0x21b4d56138273896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540281:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000affdc66f/0x21b4d56138273896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540288:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000affdc66f/0x21b4d56138273896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540308:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846297.540319:0:22636:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846297.540324:0:22636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000affdc66f/0x21b4d56138273896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540331:0:22636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f2c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846297.540345:0:22636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000affdc66f/0x21b4d56138273896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540356:0:22636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000affdc66f/0x21b4d56138273896 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540372:0:22636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000affdc66f/0x21b4d56138273896 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540379:0:22636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000affdc66f/0x21b4d56138273896 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540396:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.540402:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.540404:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846297.540853:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846297.540860:0:24581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c945f74/0x21b4d5613827389d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540869:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1788846297.540873:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846297.540877:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c945f74/0x21b4d5613827389d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540887:0:24581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c945f74/0x21b4d5613827389d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540895:0:24581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c945f74/0x21b4d5613827389d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540902:0:24581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c945f74/0x21b4d5613827389d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540916:0:24581:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846297.540923:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846297.540927:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c945f74/0x21b4d5613827389d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540933:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f2800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846297.540936:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c945f74/0x21b4d5613827389d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540968:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c945f74/0x21b4d5613827389d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540979:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c945f74/0x21b4d5613827389d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540987:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c945f74/0x21b4d5613827389d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846297.540999:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.541001:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846297.541002:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788846297.541465:0:24581:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1788846297.541576:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22674:x1875740702528768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 135358us (136254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846297.541585:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788846297.541634:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22674:1875740702528768:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788846297.541647:0:22674:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788846297.541684:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22674:1875740702529536:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788846297.541714:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846297.541740:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341daaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846297.541755:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702529536 00000100:00100000:0.0:1788846297.541760:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702529536 00000100:00100000:0.0:1788846297.541798:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788846297.541805:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22674:x1875740702529536:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788846297.541841:0:24581:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1788846297.549004:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22674:x1875740702529536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7192us (7282us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788846297.549017:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788846297.549243:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22674:1875740702529536:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788846297.549260:0:22674:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1788846297.984084:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788846298.250459:0:25328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788846298.937792:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702529664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788846298.937875:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846298.938081:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702529664 00000100:00100000:0.0:1788846298.938091:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702529664 00000100:00100000:0.0:1788846298.938153:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788846298.938172:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702529664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788846298.938200:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788846298.938256:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702529664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846298.938263:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788846298.938377:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702529664:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788846299.002378:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788846299.197503:0:25380:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788846299.197960:0:25380:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788846299.462483:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702529792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788846299.462583:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846299.462635:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702529792 00000100:00100000:1.0:1788846299.462641:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702529792 00000100:00100000:1.0:1788846299.462681:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788846299.462688:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702529792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846299.462719:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846299.462762:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702529792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846299.462774:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788846299.462813:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702529792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846299.463216:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702529920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846299.463248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846299.463279:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702529920 00000100:00100000:0.0:1788846299.463283:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702529920 00000100:00100000:0.0:1788846299.463307:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788846299.463313:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702529920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788846299.463330:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788846299.463363:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702529920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846299.463369:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788846299.463409:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702529920:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788846300.034667:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788846300.205017:0:25430:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788846300.205456:0:25430:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788846300.411105:0:23400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846300.532848:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846300.533289:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683552000 00000100:00100000:3.0:1788846300.533299:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683552000 00000100:00100000:3.0:1788846300.533346:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:3.0:1788846300.533355:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2397:x1875740683552000:12345-192.168.203.20@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788846300.533381:0:22642:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9951a80c-fa2d-4708-bd9b-b743be3211e4@192.168.203.20@tcp t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:3.0:1788846300.533409:0:22642:0:(genops.c:1385:class_connect()) connect: client 9951a80c-fa2d-4708-bd9b-b743be3211e4, cookie 0x21b4d561382738a4 00000100:00080000:2.0:1788846300.535955:0:22642:0:(import.c:65:import_set_state_nolock()) ffff90e342588000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846300.536249:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+5:2397:x1875740683552000:12345-192.168.203.20@tcp:250:mount.lustre.0 Request processed in 2888us (3403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846300.536261:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:2.0:1788846300.554424:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846300.554612:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683552128 00000100:00100000:1.0:1788846300.554623:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683552128 00000100:00100000:1.0:1788846300.554702:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:1.0:1788846300.554713:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+5:18085:x1875740683552128:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788846300.554731:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846300.554749:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46f359200/0x21b4d561382738ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754ad9 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846300.554778:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46f359200/0x21b4d561382738ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754ad9 expref: 6 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846300.554789:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46f359200/0x21b4d561382738ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754ad9 expref: 6 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846300.554798:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f359200, rc 0) 00000100:00100000:1.0:1788846300.554857:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+6:18085:x1875740683552128:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 146us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846300.554864:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:1.0:1788846300.559154:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846300.559262:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683552256 00000100:00100000:2.0:1788846300.559274:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683552256 00000100:00100000:2.0:1788846300.559340:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:2.0:1788846300.559352:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+6:18085:x1875740683552256:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788846300.559482:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+6:18085:x1875740683552256:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 133us (337us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788846300.559489:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:2.0:1788846300.564260:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846300.564428:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683552384 00000100:00100000:0.0:1788846300.564438:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683552384 00000100:00100000:0.0:1788846300.564493:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:0.0:1788846300.564504:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+6:18085:x1875740683552384:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788846300.564566:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846300.564585:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4752f3a00/0x21b4d561382738b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754ae0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846300.564614:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4752f3a00/0x21b4d561382738b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754ae0 expref: 7 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846300.564626:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4752f3a00/0x21b4d561382738b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754ae0 expref: 7 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846300.564634:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f3a00, rc 0) 00000100:00100000:0.0:1788846300.564681:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+7:18085:x1875740683552384:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 180us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846300.564687:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:0.0:1788846300.568228:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846300.574635:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683552512 00000100:00100000:1.0:1788846300.574651:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683552512 00000100:00100000:1.0:1788846300.574766:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:1.0:1788846300.574777:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+7:18085:x1875740683552512:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788846300.574959:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+8:18085:x1875740683552512:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 184us (6742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846300.574980:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:1.0:1788846300.580007:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846300.580074:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683552640 00000100:00100000:2.0:1788846300.580084:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683552640 00000100:00100000:2.0:1788846300.580203:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:2.0:1788846300.580215:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+8:18085:x1875740683552640:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788846300.580373:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475d7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+8:18085:x1875740683552640:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 160us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846300.580381:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:0.0:1788846300.585581:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846300.585839:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683552768 00000100:00100000:1.0:1788846300.585850:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683552768 00000100:00100000:1.0:1788846300.585913:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:1.0:1788846300.585924:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+8:18104:x1875740683552768:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788846300.586099:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+8:18104:x1875740683552768:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 177us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846300.586107:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:1.0:1788846300.615894:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846300.618454:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683552896 00000100:00100000:2.0:1788846300.618468:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683552896 00000100:00100000:2.0:1788846300.618672:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:2.0:1788846300.618684:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+8:18104:x1875740683552896:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788846300.618904:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+8:18104:x1875740683552896:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 222us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846300.618913:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:3.0:1788846300.628393:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846300.628659:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683553024 00000100:00100000:0.0:1788846300.628670:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683553024 00000100:00100000:0.0:1788846300.628727:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:0.0:1788846300.628737:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+8:18104:x1875740683553024:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788846300.629946:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+8:18104:x1875740683553024:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 1195us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846300.629959:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:0.0:1788846300.637362:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846300.637558:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683553152 00000100:00100000:2.0:1788846300.637679:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683553152 00000100:00100000:0.0:1788846300.637794:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:0.0:1788846300.637803:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+8:18085:x1875740683553152:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788846300.637925:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846300.638013:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4752f3e00/0x21b4d561382738b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754b11 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846300.638041:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4752f3e00/0x21b4d561382738b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b11 expref: 9 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846300.638051:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4752f3e00/0x21b4d561382738b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b11 expref: 9 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846300.638059:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f3e00, rc 0) 00000100:00100000:0.0:1788846300.638511:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+9:18085:x1875740683553152:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 706us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846300.638542:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:1.0:1788846300.643815:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846300.644071:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683553280 00000100:00100000:0.0:1788846300.644082:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683553280 00000100:00100000:0.0:1788846300.644197:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:0.0:1788846300.644207:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+9:18085:x1875740683553280:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788846300.644231:0:22641:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788846300.644256:0:22641:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788846300.644265:0:22641:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788846300.644268:0:22641:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788846300.644271:0:22641:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788846300.644273:0:22641:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788846300.647752:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+9:18085:x1875740683553280:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 3534us (3935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846300.647766:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:2.0:1788846300.651598:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846300.651798:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683553408 00000100:00100000:0.0:1788846300.651810:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683553408 00000100:00100000:0.0:1788846300.651909:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:0.0:1788846300.651920:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e448f6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+9:18085:x1875740683553408:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788846300.651936:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846300.651954:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4752f2800/0x21b4d561382738c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754b18 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846300.651992:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4752f2800/0x21b4d561382738c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b18 expref: 10 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846300.652003:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4752f2800/0x21b4d561382738c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b18 expref: 10 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846300.652013:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f2800, rc 0) 00000100:00100000:0.0:1788846300.652071:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e448f6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+10:18085:x1875740683553408:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 153us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846300.652077:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:1.0:1788846300.654615:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846300.654743:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683553536 00000100:00100000:2.0:1788846300.654754:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683553536 00000100:00100000:2.0:1788846300.654809:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:2.0:1788846300.654820:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+10:18085:x1875740683553536:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788846300.655255:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+10:18085:x1875740683553536:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 436us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846300.655263:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:1.0:1788846300.658671:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846300.658770:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683553664 00000100:00100000:2.0:1788846300.658781:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683553664 00000100:00100000:2.0:1788846300.658919:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:2.0:1788846300.658931:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+10:18085:x1875740683553664:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788846300.659218:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+10:18085:x1875740683553664:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 289us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846300.659233:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:1.0:1788846300.663575:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846300.663665:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683553792 00000100:00100000:0.0:1788846300.663675:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683553792 00000100:00100000:0.0:1788846300.663724:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:0.0:1788846300.663733:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+10:18108:x1875740683553792:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788846300.663906:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+10:18108:x1875740683553792:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 174us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846300.663914:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:1.0:1788846300.672239:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846300.672568:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683553920 00000100:00100000:2.0:1788846300.672580:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683553920 00000100:00100000:2.0:1788846300.672624:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:2.0:1788846300.672633:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+10:18108:x1875740683553920:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788846300.672792:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+10:18108:x1875740683553920:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 160us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846300.672800:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:1.0:1788846300.686107:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846300.686399:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683554048 00000100:00100000:3.0:1788846300.686409:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683554048 00000100:00100000:3.0:1788846300.686461:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1788846300.686469:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875740683554048:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788846300.686499:0:22648:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f4fd9adc-3143-4fc2-bf19-f0918d5552ac@192.168.203.20@tcp t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:3.0:1788846300.686592:0:22648:0:(genops.c:1385:class_connect()) connect: client f4fd9adc-3143-4fc2-bf19-f0918d5552ac, cookie 0x21b4d561382738c7 00000004:00100000:3.0:1788846300.686614:0:22648:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788846300.686811:0:22648:0:(import.c:65:import_set_state_nolock()) ffff90e341d65800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846300.686867:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2397:x1875740683554048:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 397us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846300.686874:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1788846300.688237:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846300.688311:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683554304 00000100:00100000:3.0:1788846300.688319:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683554304 00000100:00100000:3.0:1788846300.688362:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:3.0:1788846300.688368:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875740683554304:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788846300.688395:0:22647:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f4fd9adc-3143-4fc2-bf19-f0918d5552ac@192.168.203.20@tcp t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:3.0:1788846300.688442:0:22647:0:(genops.c:1385:class_connect()) connect: client f4fd9adc-3143-4fc2-bf19-f0918d5552ac, cookie 0x21b4d561382738ce 00000004:00100000:3.0:1788846300.688462:0:22647:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788846300.688766:0:22647:0:(import.c:65:import_set_state_nolock()) ffff90e341d63800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846300.688817:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2397:x1875740683554304:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 448us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846300.688825:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1788846300.695580:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846300.695694:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683554176 00000100:00100000:0.0:1788846300.695704:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683554176 00000100:00100000:0.0:1788846300.695780:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:0.0:1788846300.695790:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:0:x1875740683554176:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788846300.695829:0:22649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788846300.695918:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:0:x1875740683554176:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 130us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846300.695926:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00080000:3.0:1788846300.695990:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846300.697231:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846300.697307:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683554560 00000100:00100000:3.0:1788846300.697314:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683554560 00000100:00100000:3.0:1788846300.697363:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:3.0:1788846300.697372:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18085:x1875740683554560:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788846300.697395:0:22647:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788846300.697450:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18085:x1875740683554560:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846300.697457:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:2.0:1788846300.702669:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846300.704197:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846300.704970:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683554688 00000100:00100000:1.0:1788846300.704982:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683554688 00000100:00100000:1.0:1788846300.705036:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683554432 00000100:00100000:1.0:1788846300.705039:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683554432 00000100:00100000:0.0:1788846300.705088:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:0.0:1788846300.705102:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18085:x1875740683554688:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788846300.705224:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18085:x1875740683554688:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 124us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846300.705232:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:0.0:1788846300.705253:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1788846300.705260:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:0:x1875740683554432:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788846300.705281:0:22647:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788846300.705497:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:0:x1875740683554432:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 237us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846300.705514:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1788846300.709272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846300.709394:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846300.709444:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846300.709710:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683554816 00000100:00100000:1.0:1788846300.709720:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683554816 00000100:00100000:1.0:1788846300.709762:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683554944 00000100:00100000:1.0:1788846300.709765:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683554944 00000100:00100000:1.0:1788846300.709794:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:1.0:1788846300.709801:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875740683554816:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788846300.709833:0:24154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f4fd9adc-3143-4fc2-bf19-f0918d5552ac@192.168.203.20@tcp t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:1.0:1788846300.709865:0:24154:0:(genops.c:1385:class_connect()) connect: client f4fd9adc-3143-4fc2-bf19-f0918d5552ac, cookie 0x21b4d561382738d5 00002000:00100000:1.0:1788846300.709877:0:24154:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f4fd9adc-3143-4fc2-bf19-f0918d5552ac/ffff90e343bd8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788846300.709894:0:24154:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788846300.710056:0:24154:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788846300.710087:0:24154:0:(import.c:65:import_set_state_nolock()) ffff90e343bdb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846300.710166:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2397:x1875740683554816:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 364us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846300.710174:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:1.0:1788846300.710191:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:1.0:1788846300.710196:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875740683554944:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788846300.710213:0:24154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f4fd9adc-3143-4fc2-bf19-f0918d5552ac@192.168.203.20@tcp t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:1.0:1788846300.710229:0:24154:0:(genops.c:1385:class_connect()) connect: client f4fd9adc-3143-4fc2-bf19-f0918d5552ac, cookie 0x21b4d561382738dc 00002000:00100000:1.0:1788846300.710234:0:24154:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f4fd9adc-3143-4fc2-bf19-f0918d5552ac/ffff90e343bd9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788846300.710244:0:24154:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788846300.710341:0:24154:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788846300.710355:0:24154:0:(import.c:65:import_set_state_nolock()) ffff90e343bdd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846300.710378:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2397:x1875740683554944:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 180us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846300.710385:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:3.0:1788846300.711497:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683555072 00000100:00100000:3.0:1788846300.712224:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683555072 00000100:00100000:3.0:1788846300.712279:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:3.0:1788846300.712287:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18085:x1875740683555072:12345-192.168.203.20@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788846300.712404:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18085:x1875740683555072:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 118us (3140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846300.712412:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00080000:2.0:1788846300.714391:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846300.722294:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846300.722463:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683555200 00000100:00100000:1.0:1788846300.722473:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683555200 00000100:00100000:0.0:1788846300.722643:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1788846300.722655:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18085:x1875740683555200:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788846300.733549:0:22651:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 10804us 00000004:00200000:2.0:1788846300.750867:0:22651:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788846300.750987:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18085:x1875740683555200:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 28329us (28697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846300.751000:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1788846300.948997:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846300.949215:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683555328 00000100:00100000:1.0:1788846300.949226:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683555328 00000100:00100000:1.0:1788846300.949288:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:1.0:1788846300.949298:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18131:x1875740683555328:12345-192.168.203.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788846300.949317:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846300.949340:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d561382738e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754b49 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846300.949401:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d561382738ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846300.949415:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d561382738ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846300.949428:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d561382738ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846300.949476:0:22648:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788846300.949480:0:22648:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788846300.949513:0:22648:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d561382738ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846300.949580:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d561382738e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b49 expref: 8 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846300.949599:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d561382738ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b49 expref: 7 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846300.949608:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451777100) 00010000:00010000:1.0:1788846300.949623:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788846300.949627:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f358200, rc 0) 00000100:00100000:1.0:1788846300.949819:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:18131:x1875740683555328:12345-192.168.203.20@tcp:101:mkdir.0 Request processed in 522us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846300.949827:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:0.0:1788846300.991792:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702530048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788846300.991869:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846300.991989:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702530048 00000100:00100000:3.0:1788846300.991998:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702530048 00000100:00100000:3.0:1788846300.992064:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788846300.992075:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702530048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788846300.992109:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788846300.992172:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702530048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846300.992180:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788846300.992227:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702530048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788846300.992453:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788846301.049807:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846302.074547:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846302.523880:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702530176:0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.523947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846302.523990:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702530688:0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524014:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846302.524031:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702531200:0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524050:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846302.524068:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702531712:0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524093:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846302.524125:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788846302.524132:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702530304:0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524158:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846302.524175:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702530816:0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524196:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846302.524217:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702531328:0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524239:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846302.524266:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702530304 00000100:00100000:1.0:1788846302.524274:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702530304 00000100:00100000:1.0:1788846302.524307:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702530816 00000100:00100000:1.0:1788846302.524310:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702530816 00000100:00100000:1.0:1788846302.524325:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788846302.524333:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702530304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524392:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702530304:12345-0@lo:400:kworker.0 Request processed in 59us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846302.524399:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788846302.524420:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788846302.524426:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702530816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524449:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702530816:12345-0@lo:400:kworker.0 Request processed in 24us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846302.524454:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788846302.524472:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702530688 00000100:00100000:1.0:1788846302.524475:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702530688 00000100:00100000:1.0:1788846302.524493:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702531200 00000100:00100000:1.0:1788846302.524495:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702531200 00000100:00100000:1.0:1788846302.524504:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702531712 00000100:00100000:1.0:1788846302.524506:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702531712 00000100:00100000:1.0:1788846302.524552:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702531328 00000100:00100000:1.0:1788846302.524556:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702531328 00000100:00100000:1.0:1788846302.524568:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788846302.524574:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702530688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524601:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702530688:12345-0@lo:400:kworker.0 Request processed in 28us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846302.524606:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788846302.524616:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788846302.524622:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702531200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524671:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702531200:12345-0@lo:400:kworker.0 Request processed in 49us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846302.524677:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788846302.524689:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788846302.524701:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702531712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524728:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702531712:12345-0@lo:400:kworker.0 Request processed in 28us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846302.524733:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788846302.524743:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788846302.524749:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702531328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846302.524770:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702531328:12345-0@lo:400:kworker.0 Request processed in 22us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846302.524775:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788846302.524938:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702530432:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.524969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846302.524990:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702530944:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525016:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846302.525030:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702531456:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846302.525062:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788846302.525067:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702530560:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846302.525100:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702531072:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525140:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846302.525155:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702531584:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525176:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846302.525242:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702530304:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525252:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702530816:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525261:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702531328:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525270:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702530688:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525280:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702531200:0@lo:400:kworker.0 00010000:00080000:2.0:1788846302.525290:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3ed180 x1875740702531712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846302.525300:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702531712:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525334:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702531456 00000100:00100000:2.0:1788846302.525338:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702531456 00000100:00100000:2.0:1788846302.525356:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702531584 00000100:00100000:2.0:1788846302.525358:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702531584 00000100:00100000:2.0:1788846302.525369:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788846302.525375:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702531456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525406:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702531456:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846302.525412:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788846302.525424:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788846302.525429:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702531584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525450:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702531584:12345-0@lo:400:kworker.0 Request processed in 22us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846302.525463:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788846302.525488:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702531584:0@lo:400:kworker.0 00010000:00080000:2.0:1788846302.525498:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3eed80 x1875740702531456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846302.525507:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702531456:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525627:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702530432 00000100:00100000:2.0:1788846302.525631:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702530432 00000100:00100000:2.0:1788846302.525652:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702530944 00000100:00100000:2.0:1788846302.525655:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702530944 00000100:00100000:2.0:1788846302.525663:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702530560 00000100:00100000:2.0:1788846302.525665:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702530560 00000100:00100000:2.0:1788846302.525674:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702531072 00000100:00100000:2.0:1788846302.525676:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702531072 00000100:00100000:2.0:1788846302.525686:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846302.525691:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702530432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525723:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702530432:12345-0@lo:400:kworker.0 Request processed in 31us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846302.525729:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846302.525740:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788846302.525745:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702530944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525769:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702530944:12345-0@lo:400:kworker.0 Request processed in 25us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846302.525774:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788846302.525784:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788846302.525790:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875740702530560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525813:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875740702530560:12345-0@lo:400:kworker.0 Request processed in 24us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846302.525824:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788846302.525835:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846302.525840:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702531072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525867:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702531072:12345-0@lo:400:kworker.0 Request processed in 27us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846302.525873:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788846302.525887:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788846302.525890:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788846302.525893:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788846302.525895:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788846302.525911:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702530560:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525921:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702531072:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525929:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702530432:0@lo:400:kworker.0 00000100:00100000:2.0:1788846302.525937:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702530944:0@lo:400:kworker.0 00000100:00100000:0.0:1788846302.526212:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788846302.526221:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702531840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846302.526264:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846302.526373:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702531840 00000100:00100000:0.0:1788846302.526378:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702531840 00000100:00100000:0.0:1788846302.526411:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788846302.526418:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702531840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788846302.526441:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788846302.526453:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702531968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788846302.526483:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702531840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846302.526491:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788846302.526496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846302.526509:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702531968 00000100:00100000:0.0:1788846302.526513:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702531968 00000100:00100000:0.0:1788846302.526553:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788846302.526560:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702531968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788846302.526571:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788846302.526606:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702531968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846302.526609:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702530176 00000100:00100000:3.0:1788846302.526614:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702530176 00000100:00100000:0.0:1788846302.526624:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788846302.526656:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788846302.526667:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702531968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846302.526668:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3642:x1875740702530176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846302.526697:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702531840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846302.526716:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702530176:0@lo:400:kworker.0 00000100:00100000:3.0:1788846302.526721:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3642:x1875740702530176:12345-0@lo:400:kworker.0 Request processed in 55us (2771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846302.526743:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788846303.031899:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846303.032005:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683555456 00000100:00100000:2.0:1788846303.032016:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683555456 00000100:00100000:2.0:1788846303.032110:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:2.0:1788846303.032123:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:18184:x1875740683555456:12345-192.168.203.20@tcp:41:lfs.0 00000004:00000024:2.0:1788846303.032160:0:22648:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788846303.032250:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:18184:x1875740683555456:12345-192.168.203.20@tcp:41:lfs.0 Request processed in 131us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846303.032258:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00080000:0.0:1788846303.032643:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788846303.041541:0:24971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f4fd9adc-3143-4fc2-bf19-f0918d5552ac 00000001:00080000:0.0:1788846303.041560:0:24971:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:0.0:1788846303.046317:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846303.046475:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683555584 00000100:00100000:2.0:1788846303.046484:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683555584 00000100:00100000:2.0:1788846303.046614:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:2.0:1788846303.046625:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18184:x1875740683555584:12345-192.168.203.20@tcp:41:lfs.0 00000004:00000024:2.0:1788846303.046661:0:22647:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788846303.046791:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18184:x1875740683555584:12345-192.168.203.20@tcp:41:lfs.0 Request processed in 168us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846303.046799:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00080000:0.0:1788846303.050129:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846303.060767:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846303.060929:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683555712 00000100:00100000:0.0:1788846303.060940:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683555712 00000100:00100000:0.0:1788846303.061017:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:0.0:1788846303.061028:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18184:x1875740683555712:12345-192.168.203.20@tcp:13:lfs.0 00002000:00000024:0.0:1788846303.061059:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788846303.061181:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18184:x1875740683555712:12345-192.168.203.20@tcp:13:lfs.0 Request processed in 154us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846303.061188:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00080000:2.0:1788846303.062022:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846303.072883:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846303.073028:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683555840 00000100:00100000:0.0:1788846303.073039:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683555840 00000100:00100000:0.0:1788846303.073129:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1788846303.073139:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:18184:x1875740683555840:12345-192.168.203.20@tcp:13:lfs.0 00002000:00000024:0.0:1788846303.073165:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788846303.073313:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788846303.078099:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:18184:x1875740683555840:12345-192.168.203.20@tcp:13:lfs.0 Request processed in 4949us (5214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846303.078147:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00010000:00010000:0.0:1788846303.099229:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846303.297792:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846303.298001:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683555968 00000100:00100000:0.0:1788846303.298012:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683555968 00000100:00100000:0.0:1788846303.298074:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:0.0:1788846303.298083:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+10:18217:x1875740683555968:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788846303.298099:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846303.298124:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4752f2a00/0x21b4d561382738f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754b50 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846303.298153:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4752f2a00/0x21b4d561382738f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b50 expref: 11 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846303.298165:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4752f2a00/0x21b4d561382738f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b50 expref: 11 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846303.298175:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f2a00, rc 0) 00000100:00100000:0.0:1788846303.298227:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18217:x1875740683555968:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 145us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846303.298234:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:2.0:1788846303.314642:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846303.314797:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683556096 00000100:00100000:3.0:1788846303.314809:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683556096 00000100:00100000:3.0:1788846303.314871:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:3.0:1788846303.314881:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18217:x1875740683556096:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788846303.315043:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18217:x1875740683556096:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 162us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846303.315051:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:3.0:1788846303.328259:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846303.332095:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683556224 00000100:00100000:2.0:1788846303.332120:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683556224 00000100:00100000:2.0:1788846303.332192:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:2.0:1788846303.332203:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18217:x1875740683556224:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788846303.332361:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18217:x1875740683556224:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 160us (4112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846303.332369:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:1.0:1788846303.350721:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846303.351089:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683556352 00000100:00100000:0.0:1788846303.351098:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683556352 00000100:00100000:0.0:1788846303.351162:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:0.0:1788846303.351171:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18223:x1875740683556352:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788846303.351331:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18223:x1875740683556352:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 160us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846303.351347:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:0.0:1788846303.374841:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846303.374928:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683556480 00000100:00100000:3.0:1788846303.374939:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683556480 00000100:00100000:3.0:1788846303.374994:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:3.0:1788846303.375003:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18223:x1875740683556480:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788846303.375185:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18223:x1875740683556480:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 182us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846303.375194:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:3.0:1788846303.388927:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846303.389082:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683556608 00000100:00100000:2.0:1788846303.389092:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683556608 00000100:00100000:2.0:1788846303.389155:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:2.0:1788846303.389165:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18223:x1875740683556608:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788846303.389336:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18223:x1875740683556608:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 164us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846303.389344:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:1.0:1788846303.394979:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846303.395137:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683556736 00000100:00100000:0.0:1788846303.395147:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683556736 00000100:00100000:0.0:1788846303.395207:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00100000:0.0:1788846303.395217:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3437bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18217:x1875740683556736:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788846303.395232:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846303.395249:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4752f2400/0x21b4d561382738f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754b81 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846303.395280:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4752f2400/0x21b4d561382738f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b81 expref: 12 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846303.395292:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4752f2400/0x21b4d561382738f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b81 expref: 12 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846303.395301:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f2400, rc 0) 00000100:00100000:0.0:1788846303.395359:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3437bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+12:18217:x1875740683556736:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 143us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846303.395367:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00100000:0.0:1788846303.399013:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846303.399508:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683556864 00000100:00100000:3.0:1788846303.399618:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683556864 00000100:00100000:3.0:1788846303.399715:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:3.0:1788846303.399726:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+12:18217:x1875740683556864:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788846303.399753:0:22642:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788846303.399775:0:22642:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788846303.399779:0:22642:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788846303.399782:0:22642:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788846303.399785:0:22642:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788846303.399792:0:22642:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788846303.407032:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+12:18217:x1875740683556864:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 7298us (8018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846303.407046:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:1.0:1788846303.420693:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846303.420793:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683556992 00000100:00100000:2.0:1788846303.420803:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683556992 00000100:00100000:2.0:1788846303.420869:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 141 00000100:00100000:2.0:1788846303.420894:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+12:18217:x1875740683556992:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788846303.420911:0:22641:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846303.420929:0:22641:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aaac00/0x21b4d561382738ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754b88 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846303.420959:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aaac00/0x21b4d561382738ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b88 expref: 13 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846303.420970:0:22641:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aaac00/0x21b4d561382738ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b88 expref: 13 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846303.420979:0:22641:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaac00, rc 0) 00000100:00100000:2.0:1788846303.421040:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18217:x1875740683556992:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 148us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846303.421047:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 141 00000100:00100000:2.0:1788846303.424360:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846303.424449:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683557120 00000100:00100000:1.0:1788846303.424460:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683557120 00000100:00100000:1.0:1788846303.424518:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:1.0:1788846303.424569:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18217:x1875740683557120:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788846303.424711:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18217:x1875740683557120:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 143us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846303.424718:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:3.0:1788846303.427604:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846303.429653:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683557248 00000100:00100000:0.0:1788846303.429668:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683557248 00000100:00100000:0.0:1788846303.429739:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:0.0:1788846303.429749:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18217:x1875740683557248:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788846303.431389:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18217:x1875740683557248:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 1625us (3775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846303.431410:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:0.0:1788846303.437034:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846303.437309:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683557376 00000100:00100000:2.0:1788846303.437319:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683557376 00000100:00100000:2.0:1788846303.437414:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 144 00000100:00100000:2.0:1788846303.437423:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18229:x1875740683557376:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788846303.437619:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18229:x1875740683557376:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 196us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846303.437627:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 144 00000100:00100000:3.0:1788846303.443282:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846303.450366:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683557504 00000100:00100000:2.0:1788846303.450382:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683557504 00000100:00100000:2.0:1788846303.450445:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:2.0:1788846303.450455:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18229:x1875740683557504:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788846303.450642:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18229:x1875740683557504:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 188us (7369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846303.450651:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:0.0:1788846303.458725:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846303.458826:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846303.459223:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683558272 00000100:00100000:3.0:1788846303.459232:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683558272 00000100:00100000:3.0:1788846303.459290:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:3.0:1788846303.459302:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:2399:x1875740683558272:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846303.459372:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:2399:x1875740683558272:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 73us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846303.459381:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:2.0:1788846303.459668:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683558528 00000100:00100000:2.0:1788846303.459673:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683558528 00000100:00100000:2.0:1788846303.459708:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:2.0:1788846303.459716:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2399:x1875740683558528:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846303.459749:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2399:x1875740683558528:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 34us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846303.459756:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:0.0:1788846303.461437:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846303.461477:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846303.461555:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683558400 00000100:00100000:3.0:1788846303.461564:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683558400 00000100:00100000:3.0:1788846303.461609:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683557632 00000100:00100000:3.0:1788846303.461612:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683557632 00000100:00100000:3.0:1788846303.461624:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:3.0:1788846303.461632:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2399:x1875740683558400:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846303.461706:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2399:x1875740683558400:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 74us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846303.461713:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:3.0:1788846303.461729:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1788846303.461733:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875740683557632:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788846303.461755:0:22648:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 02f36bf9-fda5-4feb-9347-af042b323ea9@192.168.203.20@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:3.0:1788846303.461790:0:22648:0:(genops.c:1385:class_connect()) connect: client 02f36bf9-fda5-4feb-9347-af042b323ea9, cookie 0x21b4d56138273906 00000004:00100000:3.0:1788846303.461814:0:22648:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788846303.461900:0:22648:0:(import.c:65:import_set_state_nolock()) ffff90e341d62000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846303.461929:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+6:2397:x1875740683557632:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 194us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846303.461951:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:2.0:1788846303.466610:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846303.466692:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683557888 00000100:00100000:3.0:1788846303.466702:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683557888 00000100:00100000:3.0:1788846303.466749:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1788846303.466757:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875740683557888:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788846303.466785:0:22648:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 02f36bf9-fda5-4feb-9347-af042b323ea9@192.168.203.20@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:3.0:1788846303.466822:0:22648:0:(genops.c:1385:class_connect()) connect: client 02f36bf9-fda5-4feb-9347-af042b323ea9, cookie 0x21b4d5613827390d 00000004:00100000:3.0:1788846303.466847:0:22648:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788846303.466930:0:22648:0:(import.c:65:import_set_state_nolock()) ffff90e34382b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846303.467006:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+6:2397:x1875740683557888:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 248us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846303.467015:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1788846303.471933:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846303.472027:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683557760 00000100:00100000:1.0:1788846303.472038:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683557760 00000100:00100000:1.0:1788846303.472126:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1788846303.472149:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+6:0:x1875740683557760:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788846303.472181:0:22649:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788846303.472307:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+6:0:x1875740683557760:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 161us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846303.472315:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00080000:2.0:1788846303.473172:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846303.477331:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846303.477434:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683558144 00000100:00100000:0.0:1788846303.477444:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683558144 00000100:00100000:0.0:1788846303.477570:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:0.0:1788846303.477582:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+6:18217:x1875740683558144:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788846303.477615:0:22647:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788846303.477690:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+6:18217:x1875740683558144:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 111us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846303.477698:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1788846303.480165:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846303.482069:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683558016 00000100:00100000:1.0:1788846303.482150:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683558016 00000100:00080000:3.0:1788846303.482244:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846303.482294:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:0.0:1788846303.482307:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+6:0:x1875740683558016:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788846303.482341:0:22647:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788846303.482419:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+6:0:x1875740683558016:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 114us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846303.482427:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1788846303.482582:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846303.484322:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683558656 00000100:00100000:2.0:1788846303.484336:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683558656 00000100:00100000:2.0:1788846303.484385:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1788846303.484393:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+6:18217:x1875740683558656:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788846303.484472:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+6:18217:x1875740683558656:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 79us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846303.484480:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:3.0:1788846303.491233:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846303.491278:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846303.491307:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683558784 00000100:00100000:3.0:1788846303.491318:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683558784 00000100:00100000:3.0:1788846303.491356:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683558912 00000100:00100000:3.0:1788846303.491359:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683558912 00000100:00100000:3.0:1788846303.491380:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1788846303.491389:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875740683558784:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788846303.491424:0:24155:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 02f36bf9-fda5-4feb-9347-af042b323ea9@192.168.203.20@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:3.0:1788846303.491458:0:24155:0:(genops.c:1385:class_connect()) connect: client 02f36bf9-fda5-4feb-9347-af042b323ea9, cookie 0x21b4d56138273914 00000100:00100000:1.0:1788846303.491468:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00002000:00100000:3.0:1788846303.491471:0:24155:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 02f36bf9-fda5-4feb-9347-af042b323ea9/ffff90e34382a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1788846303.491476:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875740683558912:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788846303.491497:0:24156:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 02f36bf9-fda5-4feb-9347-af042b323ea9@192.168.203.20@tcp t0 exp 0000000000000000 cur 687 last 0 00002000:00100000:3.0:1788846303.491499:0:24155:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788846303.491589:0:24155:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:1.0:1788846303.491601:0:24156:0:(genops.c:1385:class_connect()) connect: client 02f36bf9-fda5-4feb-9347-af042b323ea9, cookie 0x21b4d5613827391b 00002000:00100000:1.0:1788846303.491610:0:24156:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 02f36bf9-fda5-4feb-9347-af042b323ea9/ffff90e3427c9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788846303.491617:0:24156:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788846303.491619:0:24155:0:(import.c:65:import_set_state_nolock()) ffff90e34382b800 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1788846303.491667:0:24156:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1788846303.491678:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+6:2397:x1875740683558784:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 287us (453us total) trans 0 rc 0/0 00000100:00080000:1.0:1788846303.491686:0:24156:0:(import.c:65:import_set_state_nolock()) ffff90e3427c9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846303.491687:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:1.0:1788846303.491720:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+6:2397:x1875740683558912:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 243us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846303.491728:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1788846303.492049:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846303.492182:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683559040 00000100:00100000:3.0:1788846303.492188:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683559040 00000100:00100000:3.0:1788846303.492221:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:3.0:1788846303.492229:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02f36bf9-fda5-4feb-9347-af042b323ea9+6:18217:x1875740683559040:12345-192.168.203.20@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788846303.492264:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02f36bf9-fda5-4feb-9347-af042b323ea9+6:18217:x1875740683559040:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 37us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846303.492271:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:3.0:1788846303.495114:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846303.495473:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683559168 00000100:00100000:1.0:1788846303.495484:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683559168 00000100:00100000:2.0:1788846303.495636:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:1.0:1788846303.495643:0:22650:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788846303.495651:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+6:18217:x1875740683559168:12345-192.168.203.20@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788846303.495655:0:22650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00200000:2.0:1788846303.495749:0:22651:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788846303.495838:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+6:18217:x1875740683559168:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 191us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846303.495870:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:2.0:1788846303.688992:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846303.689164:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683559296 00000100:00100000:3.0:1788846303.689173:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683559296 00000100:00100000:3.0:1788846303.689232:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1788846303.689242:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+6:18252:x1875740683559296:12345-192.168.203.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788846303.689261:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846303.689282:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138273922 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754bb9 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846303.689347:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846303.689360:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846303.689386:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846303.689430:0:22648:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788846303.689434:0:22648:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846303.689469:0:22648:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846303.689496:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138273922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bb9 expref: 8 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846303.689514:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bb9 expref: 7 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846303.689571:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451777100) 00010000:00010000:3.0:1788846303.689574:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788846303.689578:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2800, rc 0) 00000100:00100000:3.0:1788846303.689654:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+7:18252:x1875740683559296:12345-192.168.203.20@tcp:101:mkdir.0 Request processed in 414us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846303.689662:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1788846304.058006:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702532096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846304.058111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846304.058553:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702532096 00000100:00100000:0.0:1788846304.058561:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702532096 00000100:00100000:0.0:1788846304.058642:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788846304.058654:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702532096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788846304.058683:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788846304.058749:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702532096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846304.058757:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788846304.059064:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846304.059123:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702532096:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788846304.130481:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846304.576411:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702532352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788846304.576491:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846304.576552:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788846304.576559:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702532224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788846304.576602:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846304.576635:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702532352 00000100:00100000:1.0:1788846304.576643:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702532352 00000100:00100000:1.0:1788846304.576679:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702532224 00000100:00100000:1.0:1788846304.576682:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702532224 00000100:00100000:1.0:1788846304.576719:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788846304.576728:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702532352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788846304.576761:0:22653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788846304.576805:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702532352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846304.576812:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788846304.576828:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788846304.576835:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702532224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846304.576850:0:22653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846304.576876:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702532224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 41us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846304.576881:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788846304.576918:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702532224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788846304.576931:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702532352:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788846305.149216:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846306.106737:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702532480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788846306.106809:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846306.106941:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702532480 00000100:00100000:1.0:1788846306.106950:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702532480 00000100:00100000:1.0:1788846306.107058:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788846306.107069:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702532480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788846306.107105:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788846306.107157:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702532480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846306.107177:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788846306.107863:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702532480:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788846306.108794:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788846306.169735:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788846306.810217:0:25529:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788846307.132233:0:23380:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 02f36bf9-fda5-4feb-9347-af042b323ea9 00000001:00100000:1.0:1788846307.132248:0:23380:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f4fd9adc-3143-4fc2-bf19-f0918d5552ac 00000001:00100000:2.0:1788846307.133376:0:24150:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 02f36bf9-fda5-4feb-9347-af042b323ea9 00000001:00100000:2.0:1788846307.133386:0:24150:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f4fd9adc-3143-4fc2-bf19-f0918d5552ac 00000001:00100000:3.0:1788846307.136975:0:22627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 02f36bf9-fda5-4feb-9347-af042b323ea9 00000001:00100000:3.0:1788846307.137012:0:22627:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f4fd9adc-3143-4fc2-bf19-f0918d5552ac 00010000:00010000:0.0:1788846307.198466:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846307.641697:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788846307.641721:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702532608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846307.641783:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846307.641844:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702532608 00000100:00100000:0.0:1788846307.641852:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702532608 00000100:00100000:0.0:1788846307.641901:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788846307.641910:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702532608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788846307.641934:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788846307.641987:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702532608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846307.641994:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788846307.642029:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788846307.642050:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702532608:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788846307.642152:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846307.642160:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788846307.642170:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702532736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846307.642201:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846307.642225:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702532736 00000100:00100000:3.0:1788846307.642228:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702532736 00000100:00100000:3.0:1788846307.642253:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788846307.642258:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702532736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788846307.642277:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788846307.642305:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702532736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846307.642311:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788846307.642325:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846307.642341:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702532736:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788846307.643227:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846307.647896:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702532992:0@lo:400:kworker.0 00000100:00100000:0.0:1788846307.647976:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846307.648018:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702533504:0@lo:400:kworker.0 00000100:00100000:0.0:1788846307.648043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846307.648084:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702534016:0@lo:400:kworker.0 00000100:00100000:0.0:1788846307.648110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846307.648135:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788846307.648141:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702533120:0@lo:400:kworker.0 00000100:00100000:0.0:1788846307.648163:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846307.648179:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702533632:0@lo:400:kworker.0 00000100:00100000:0.0:1788846307.648197:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846307.648214:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702534144:0@lo:400:kworker.0 00000100:00100000:0.0:1788846307.648237:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846307.648266:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702532992 00000100:00100000:0.0:1788846307.648273:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702532992 00000100:00100000:0.0:1788846307.648324:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788846307.648332:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702532992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846307.648385:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702532992:12345-0@lo:400:kworker.0 Request processed in 53us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846307.648391:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788846307.648414:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702533504 00000100:00100000:0.0:1788846307.648418:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702533504 00000100:00100000:0.0:1788846307.648448:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702533120 00000100:00100000:0.0:1788846307.648452:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702533120 00000100:00100000:0.0:1788846307.648468:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788846307.648473:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702533504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846307.648503:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702533504:12345-0@lo:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846307.648509:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788846307.648721:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702533248:0@lo:400:kworker.0 00000100:00100000:2.0:1788846307.648752:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846307.648766:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702533760:0@lo:400:kworker.0 00000100:00100000:2.0:1788846307.648784:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846307.648798:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788846307.648802:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702532864:0@lo:400:kworker.0 00000100:00100000:2.0:1788846307.648828:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846307.649752:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788846307.649769:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702533120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846307.649827:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702533120:12345-0@lo:400:kworker.0 Request processed in 66us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846307.649834:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788846307.650046:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702532864 00000100:00100000:3.0:1788846307.650052:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702532864 00000100:00100000:3.0:1788846307.650101:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788846307.650108:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3642:x1875740702532864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846307.650141:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3642:x1875740702532864:12345-0@lo:400:kworker.0 Request processed in 35us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846307.650157:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788846307.650202:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702534016 00000100:00100000:3.0:1788846307.650207:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702534016 00000100:00100000:3.0:1788846307.650229:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702533632 00000100:00100000:3.0:1788846307.650232:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702533632 00000100:00100000:3.0:1788846307.650244:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702534144 00000100:00100000:3.0:1788846307.650246:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702534144 00000100:00100000:3.0:1788846307.650258:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702533248 00000100:00100000:3.0:1788846307.651536:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702533248 00000100:00100000:3.0:1788846307.651571:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702533760 00000100:00100000:3.0:1788846307.651574:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702533760 00000100:00100000:3.0:1788846307.651594:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788846307.651601:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702534016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846307.651661:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702534016:12345-0@lo:400:kworker.0 Request processed in 60us (3549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846307.651667:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788846307.651681:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788846307.651687:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702533632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846307.651715:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702533632:12345-0@lo:400:kworker.0 Request processed in 29us (3517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846307.651721:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788846307.651731:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788846307.651737:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702534144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846307.651764:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702534144:12345-0@lo:400:kworker.0 Request processed in 28us (3527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846307.651770:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788846307.651781:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788846307.651799:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702533248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846307.651843:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702533248:12345-0@lo:400:kworker.0 Request processed in 45us (3090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846307.651849:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788846307.651861:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788846307.651867:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702533760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846307.651893:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702533760:12345-0@lo:400:kworker.0 Request processed in 27us (3108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846307.651899:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788846307.653180:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702532864:0@lo:400:kworker.0 00000100:00100000:2.0:1788846307.653194:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702533376:0@lo:400:kworker.0 00000100:00100000:2.0:1788846307.653243:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846307.653273:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702533888:0@lo:400:kworker.0 00000100:00100000:2.0:1788846307.653298:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846307.653326:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702533248:0@lo:400:kworker.0 00000100:00100000:2.0:1788846307.653336:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702533760:0@lo:400:kworker.0 00000100:00100000:2.0:1788846307.653372:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702533376 00000100:00100000:2.0:1788846307.653377:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702533376 00000100:00100000:2.0:1788846307.653412:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788846307.653419:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702533376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846307.653462:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702533376:12345-0@lo:400:kworker.0 Request processed in 44us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846307.653480:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788846307.653502:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702533888 00000100:00100000:2.0:1788846307.653506:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702533888 00000100:00100000:2.0:1788846307.653554:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788846307.653561:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702533888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846307.653592:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702533888:12345-0@lo:400:kworker.0 Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846307.653597:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788846307.653625:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702533376:0@lo:400:kworker.0 00010000:00080000:2.0:1788846307.653636:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e34443a300 x1875740702533888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846307.653645:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702533888:0@lo:400:kworker.0 00000100:00080000:3.0:1788846307.653726:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788846307.653730:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788846307.653734:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846307.653758:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702533120:0@lo:400:kworker.0 00000100:00100000:3.0:1788846307.653769:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702533632:0@lo:400:kworker.0 00010000:00080000:3.0:1788846307.653781:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e344439880 x1875740702534144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846307.653790:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702534144:0@lo:400:kworker.0 00000100:00100000:3.0:1788846307.653801:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702532992:0@lo:400:kworker.0 00000100:00100000:3.0:1788846307.653812:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702533504:0@lo:400:kworker.0 00000100:00100000:3.0:1788846307.653827:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702534016:0@lo:400:kworker.0 00010000:00010000:1.0:1788846308.218661:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788846308.670819:0:24971:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 02f36bf9-fda5-4feb-9347-af042b323ea9 00000100:00100000:3.0:1788846308.723311:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846308.723346:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846308.723366:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846308.723391:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846308.723412:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846308.723428:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846308.723443:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846308.723459:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846308.723473:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846308.723498:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683559808 00000100:00100000:3.0:1788846308.723508:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683559808 00000100:00100000:3.0:1788846308.723580:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683560320 00000100:00100000:3.0:1788846308.723584:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683560320 00000100:00100000:3.0:1788846308.723599:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683559936 00000100:00100000:3.0:1788846308.723601:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683559936 00000100:00100000:3.0:1788846308.723613:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683560448 00000100:00100000:3.0:1788846308.723615:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683560448 00000100:00100000:3.0:1788846308.723630:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1788846308.723640:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2400:x1875740683559808:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846308.723708:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2400:x1875740683559808:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 69us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846308.723716:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1788846308.723732:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:3.0:1788846308.723738:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2400:x1875740683560320:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846308.723761:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2400:x1875740683560320:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846308.723767:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:3.0:1788846308.723777:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1788846308.723781:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2400:x1875740683559936:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846308.723799:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2400:x1875740683559936:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 18us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846308.723811:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1788846308.723822:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1788846308.723826:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2400:x1875740683560448:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846308.723845:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2400:x1875740683560448:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 19us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846308.723851:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1788846308.723867:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683559552 00000100:00100000:3.0:1788846308.723870:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683559552 00000100:00100000:3.0:1788846308.723888:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683560064 00000100:00100000:3.0:1788846308.723890:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683560064 00000100:00100000:3.0:1788846308.723901:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683559680 00000100:00100000:3.0:1788846308.723902:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683559680 00000100:00100000:3.0:1788846308.723912:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683560192 00000100:00100000:3.0:1788846308.723914:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683560192 00000100:00100000:3.0:1788846308.723935:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:3.0:1788846308.723941:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2400:x1875740683559552:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846308.723970:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2400:x1875740683559552:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846308.723976:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:3.0:1788846308.723986:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1788846308.723992:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+6:2400:x1875740683560064:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846308.724011:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+6:2400:x1875740683560064:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 20us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846308.724016:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1788846308.724026:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1788846308.724038:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2400:x1875740683559680:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846308.724062:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2400:x1875740683559680:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 25us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846308.724080:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1788846308.724092:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:3.0:1788846308.724098:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2400:x1875740683560192:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846308.724120:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2400:x1875740683560192:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846308.724126:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:3.0:1788846308.724146:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683559424 00000100:00100000:3.0:1788846308.724150:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683559424 00000100:00100000:3.0:1788846308.724174:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00100000:3.0:1788846308.724180:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:2400:x1875740683559424:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846308.724199:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:2400:x1875740683559424:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 20us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846308.724205:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00080000:3.0:1788846308.724234:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788846308.724238:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788846308.724240:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788846308.724242:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788846309.184398:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702534272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788846309.184472:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846309.187093:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702534272 00000100:00100000:3.0:1788846309.187107:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702534272 00000100:00100000:3.0:1788846309.187172:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788846309.187182:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702534272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788846309.187215:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788846309.197878:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702534272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10688us (13395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846309.197900:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788846309.197972:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788846309.210895:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702534272:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788846309.242686:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846309.693696:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788846309.693721:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702534400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788846309.693794:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846309.693845:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702534400 00000100:00100000:2.0:1788846309.693854:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702534400 00000100:00100000:2.0:1788846309.693915:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788846309.693925:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702534400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788846309.693957:0:22653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788846309.694423:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702534400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 497us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846309.694431:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788846309.694488:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702534400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788846309.698375:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788846309.698397:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702534528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846309.698466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846309.705481:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702534528 00000100:00100000:1.0:1788846309.705502:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702534528 00000100:00100000:1.0:1788846309.705610:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788846309.705621:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702534528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788846309.705662:0:22653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788846309.705757:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702534528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (7290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846309.705764:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788846309.706668:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702534528:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788846310.269616:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788846310.504822:0:25677:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6c634570 20000000:00000080:2.0:1788846310.504845:0:25677:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90e476743800 uarg=0000000000000000 20000000:01000000:2.0:1788846310.504887:0:25677:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788846310.504894:0:25677:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788846310.504899:0:25677:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788846310.508705:0:25678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788846310.509731:0:25677:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788846310.525848:0:25677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788846310.526121:0:25677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526142:0:25677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42c600/0x21b4d5613827358d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273586 expref: 23 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526150:0:25677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342a0c000/0x21b4d5613827359b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273594 expref: 23 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526156:0:25677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342a0ca00/0x21b4d561382735da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382735d3 expref: 23 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526163:0:25677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42da00/0x21b4d56138273754 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827374d expref: 23 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526172:0:25677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4752f2800/0x21b4d561382738c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b18 expref: 12 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526195:0:25677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342aaac00/0x21b4d561382738ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b88 expref: 12 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526201:0:25677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526244:0:25677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342aaac00/0x21b4d561382738ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b88 expref: 12 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526262:0:25677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342aaac00/0x21b4d561382738ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b88 expref: 12 pid: 22641 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846310.526277:0:25677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702534656:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846310.526381:0:25677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4752f2800/0x21b4d561382738c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b18 expref: 12 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526390:0:25677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e4752f2800/0x21b4d561382738c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b18 expref: 12 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846310.526399:0:25677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702534784:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846310.526447:0:25677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42da00/0x21b4d56138273754 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827374d expref: 23 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526455:0:25677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e46d42da00/0x21b4d56138273754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827374d expref: 23 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846310.526464:0:25677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702534912:0@lo:104: 00000100:00100000:2.0:1788846310.526504:0:25677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846310.526578:0:25677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342a0ca00/0x21b4d561382735da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382735d3 expref: 23 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526586:0:25677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342a0ca00/0x21b4d561382735da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382735d3 expref: 23 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846310.526593:0:25677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702535040:0@lo:104: 00000100:00100000:2.0:1788846310.526614:0:25677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846310.526639:0:25677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342a0c000/0x21b4d5613827359b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138273594 expref: 23 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526647:0:25677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342a0c000/0x21b4d5613827359b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138273594 expref: 23 pid: 22641 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846310.526655:0:25677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702535168:0@lo:104: 00000100:00100000:2.0:1788846310.526674:0:25677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846310.526694:0:25677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42c600/0x21b4d5613827358d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138273586 expref: 23 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.526702:0:25677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e46d42c600/0x21b4d5613827358d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138273586 expref: 23 pid: 22642 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846310.526709:0:25677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702535296:0@lo:104: 00000100:00100000:2.0:1788846310.526727:0:25677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846310.526737:0:25677:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846310.527262:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702534912 00000100:00100000:1.0:1788846310.527271:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702534912 00000100:00100000:1.0:1788846310.527311:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702535040 00000100:00100000:1.0:1788846310.527315:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702535040 00000100:00100000:1.0:1788846310.527325:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702535168 00000100:00100000:1.0:1788846310.527328:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702535168 00000100:00100000:1.0:1788846310.527337:0:22630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702535296 00000100:00100000:1.0:1788846310.527340:0:22630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702535296 00000100:00100000:1.0:1788846310.527353:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788846310.527363:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+6:25677:x1875740702534912:12345-0@lo:104: 00010000:00010000:1.0:1788846310.527376:0:22630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.527451:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788846310.527466:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+6:25677:x1875740702534912:12345-0@lo:104: Request processed in 105us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846310.527473:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788846310.527490:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788846310.527496:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+5:25677:x1875740702535040:12345-0@lo:104: 00010000:00010000:1.0:1788846310.527504:0:22630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.527565:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788846310.527570:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+5:25677:x1875740702535040:12345-0@lo:104: Request processed in 75us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846310.527576:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788846310.527587:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788846310.527593:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:25677:x1875740702535168:12345-0@lo:104: 00010000:00010000:1.0:1788846310.527601:0:22630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.527631:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788846310.527635:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+4:25677:x1875740702535168:12345-0@lo:104: Request processed in 43us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846310.527641:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788846310.527653:0:22630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788846310.527659:0:22630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+3:25677:x1875740702535296:12345-0@lo:104: 00010000:00010000:1.0:1788846310.527666:0:22630:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.527692:0:22630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788846310.527704:0:22630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+3:25677:x1875740702535296:12345-0@lo:104: Request processed in 46us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846310.527709:0:22630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788846310.527726:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788846310.527732:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.527739:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846310.527743:0:23801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.527751:0:23801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846310.527758:0:23801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846310.527765:0:23801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788846310.527806:0:23801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.527812:0:23801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846310.527832:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.527839:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e4752f3000/0x21b4d5613827374d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138273754 expref: -99 pid: 24970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.527851:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788846310.527854:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.527868:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846310.528201:0:23801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528209:0:23801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846310.528215:0:23801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846310.528219:0:23801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788846310.528234:0:23801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528240:0:23801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846310.528256:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528263:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342aab400/0x21b4d561382735d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382735da expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528273:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788846310.528276:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528282:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846310.528285:0:23801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528303:0:23801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846310.528310:0:23801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846310.528315:0:23801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788846310.528331:0:23801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528337:0:23801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846310.528343:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528350:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342aab800/0x21b4d56138273594 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827359b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528360:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846310.528362:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528368:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846310.528371:0:23801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528378:0:23801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846310.528384:0:23801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846310.528395:0:23801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788846310.528410:0:23801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528416:0:23801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846310.528423:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528496:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138273586 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827358d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528511:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846310.528512:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846310.528514:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846310.528545:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846310.528568:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702535424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846310.528610:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846310.528642:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846310.528648:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702535808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846310.528667:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846310.528694:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702535552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788846310.528714:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846310.528715:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846310.528731:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846310.528736:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702535680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788846310.528752:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702535424 00000100:00100000:1.0:1788846310.528754:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846310.528757:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702535424 00000100:00100000:1.0:1788846310.528776:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702535808 00000100:00100000:1.0:1788846310.528779:0:22634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702535808 00010000:00010000:0.0:1788846310.528780:0:22633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42da00/0x21b4d56138273754 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827374d expref: 24 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528795:0:22634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42c600/0x21b4d5613827358d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273586 expref: 25 pid: 22642 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846310.528795:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702535552 00000100:00100000:0.0:1788846310.528797:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702535552 00010000:00010000:0.0:1788846310.528805:0:22633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342a0ca00/0x21b4d561382735da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382735d3 expref: 26 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846310.528806:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702535680 00000100:00100000:1.0:1788846310.528809:0:22634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702535680 00000100:00100000:0.0:1788846310.528816:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788846310.528817:0:22634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342a0c000/0x21b4d5613827359b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273594 expref: 27 pid: 22641 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846310.528822:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+27:3641:x1875740702535424:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846310.528827:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788846310.528831:0:22633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788846310.528832:0:22634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+27:3641:x1875740702535808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788846310.528836:0:22633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42da00/0x21b4d56138273754 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827374d expref: 27 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.528837:0:22634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846310.528841:0:22634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42c600/0x21b4d5613827358d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273586 expref: 27 pid: 22642 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846310.528845:0:22633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42da00/0x21b4d56138273754 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827374d expref: 27 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846310.528961:0:25677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702534912:0@lo:104: 00000100:00100000:2.0:1788846310.528972:0:25677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702535040:0@lo:104: 00000100:00100000:2.0:1788846310.528980:0:25677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702535168:0@lo:104: 00000100:00100000:2.0:1788846310.528989:0:25677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702535296:0@lo:104: 00010000:00010000:1.0:1788846310.529566:0:22634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42c600/0x21b4d5613827358d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138273586 expref: 27 pid: 22642 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.529584:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c600/0x21b4d5613827358d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138273586 expref: 27 pid: 22642 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.529596:0:22634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846310.529640:0:22634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+26:3641:x1875740702535808:12345-0@lo:103:ldlm_bl.0 Request processed in 807us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846310.529648:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788846310.529668:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788846310.529675:0:22634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+25:3642:x1875740702535552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846310.529685:0:22634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846310.529690:0:22634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342a0ca00/0x21b4d561382735da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382735d3 expref: 25 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.529708:0:22634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342a0ca00/0x21b4d561382735da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382735d3 expref: 25 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.529718:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0ca00/0x21b4d561382735da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382735d3 expref: 25 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.529727:0:22634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846310.529755:0:22634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3642:x1875740702535552:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846310.529761:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788846310.529777:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788846310.529783:0:22634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:3642:x1875740702535680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846310.529802:0:22634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846310.529807:0:22634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342a0c000/0x21b4d5613827359b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138273594 expref: 23 pid: 22641 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.529815:0:22634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342a0c000/0x21b4d5613827359b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138273594 expref: 23 pid: 22641 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.529823:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0c000/0x21b4d5613827359b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138273594 expref: 23 pid: 22641 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846310.529832:0:22634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846310.529852:0:22634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:3642:x1875740702535680:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846310.529858:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788846310.530556:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702535680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846310.530568:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702535552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846310.531210:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702535808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788846310.532210:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42da00/0x21b4d56138273754 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827374d expref: 21 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846310.532227:0:22633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846310.532299:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:3641:x1875740702535424:12345-0@lo:103:ldlm_bl.0 Request processed in 3476us (3688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846310.532308:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846310.532360:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3641:1875740702535424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846310.533352:0:25677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702534656:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846310.533365:0:25677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25677:1875740702534784:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846310.533402:0:25677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846310.537210:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846310.537302:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846310.537765:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683560704 00000100:00100000:2.0:1788846310.537775:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683560704 00010000:00010000:2.0:1788846310.537831:0:22632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4752f2800/0x21b4d561382738c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b18 expref: 13 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846310.538156:0:23802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683560576 00000100:00100000:0.0:1788846310.538161:0:23802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683560576 00010000:00010000:0.0:1788846310.538183:0:23802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342aaac00/0x21b4d561382738ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b88 expref: 14 pid: 22641 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846310.538185:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:2.0:1788846310.538195:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9951a80c-fa2d-4708-bd9b-b743be3211e4+14:2399:x1875740683560704:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846310.538211:0:22632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846310.538217:0:22632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4752f2800/0x21b4d561382738c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b18 expref: 14 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.538228:0:22632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4752f2800/0x21b4d561382738c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b18 expref: 14 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846310.538231:0:23802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:0.0:1788846310.538237:0:23802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9951a80c-fa2d-4708-bd9b-b743be3211e4+14:2399:x1875740683560576:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846310.538245:0:23802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846310.538249:0:23802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342aaac00/0x21b4d561382738ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b88 expref: 14 pid: 22641 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.538256:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4752f2800/0x21b4d561382738c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b18 expref: 14 pid: 22640 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846310.538258:0:23802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342aaac00/0x21b4d561382738ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b88 expref: 14 pid: 22641 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846310.538267:0:23802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aaac00/0x21b4d561382738ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b88 expref: 13 pid: 22641 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.538273:0:22632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.538294:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846310.543436:0:23802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846310.543547:0:23802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9951a80c-fa2d-4708-bd9b-b743be3211e4+12:2399:x1875740683560576:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 5302us (6237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846310.543560:0:23802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00010000:00010000:2.0:1788846310.545415:0:22632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.545440:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.545448:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.545455:0:22632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.545461:0:22632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aabc00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846310.545467:0:22632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.545474:0:22632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.545652:0:22632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846310.545667:0:22632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846310.545722:0:25677:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846310.545730:0:25677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846310.545732:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:2399:x1875740683560704:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 7535us (8527us total) trans 0 rc 0/0 00010000:00010000:0.0:1788846310.545737:0:25677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342aabc00/0x21b4d56138273930 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846310.545741:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000040:00080000:1.0:1788846310.651773:0:23400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788846311.227041:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702535936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846311.227134:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846311.227334:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702535936 00000100:00100000:3.0:1788846311.227343:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702535936 00000100:00100000:3.0:1788846311.227412:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788846311.227421:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702535936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788846311.227450:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00080000:0.0:1788846311.227603:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846311.227941:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702535936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 519us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846311.227949:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788846311.228072:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702535936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788846311.289750:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788846311.673812:0:22644:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788846311.673819:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e34440e000 from 13 10000000:01000000:0.0:1788846311.673840:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788846311.673886:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4752f3400/0x21b4d56138273937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846311.673899:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e4752f3400/0x21b4d56138273937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846311.673910:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e4752f3400/0x21b4d56138273937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846311.673933:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846311.674127:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846311.674172:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469a716c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846311.674243:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702536064 00000100:00100000:2.0:1788846311.674251:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702536064 00000100:00100000:2.0:1788846311.674322:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788846311.674331:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+20:22644:x1875740702536064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846311.674344:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846311.674358:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aaa200/0x21b4d5613827393e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273937 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.674379:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aaa200/0x21b4d5613827393e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273937 expref: 21 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.674390:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aaa200/0x21b4d5613827393e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273937 expref: 21 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.674399:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa200, rc 0) 00000100:00100000:2.0:1788846311.674448:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:22644:x1875740702536064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846311.674456:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788846311.674694:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846311.674720:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e4752f3400/0x21b4d56138273937 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827393e expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846311.674730:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e4752f3400/0x21b4d56138273937 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827393e expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846311.674803:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788846311.674833:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846311.674860:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469a716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846311.675070:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702536192 00000100:00100000:3.0:1788846311.675076:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702536192 00000100:00100000:3.0:1788846311.675111:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788846311.675118:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:22644:x1875740702536192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846311.675235:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:22644:x1875740702536192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846311.675242:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788846311.675837:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788846311.675873:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788846311.675924:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846311.676001:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469a716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846311.678603:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702536320 00000100:00100000:3.0:1788846311.678619:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702536320 00000100:00100000:3.0:1788846311.678946:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788846311.678957:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:22644:x1875740702536320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846311.679163:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:22644:x1875740702536320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (3238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846311.679170:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788846311.679268:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788846311.684258:0:25690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788846311.686100:0:22644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788846311.686138:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788846311.686149:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4752f3400/0x21b4d56138273937 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827393e expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.686161:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e4752f3400/0x21b4d56138273937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827393e expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846311.686193:0:22644:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788846311.686195:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e34377d800 from 13 10000000:01000000:2.0:1788846311.686198:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788846311.686235:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.686243:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.686254:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846311.686279:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.686960:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846311.687120:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846311.688951:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702536448 00000100:00100000:3.0:1788846311.688973:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702536448 00000100:00100000:3.0:1788846311.689052:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788846311.689063:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+21:22644:x1875740702536448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846311.689079:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846311.689098:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e3600/0x21b4d5613827394c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273945 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846311.689125:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e3600/0x21b4d5613827394c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273945 expref: 22 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846311.689137:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e3600/0x21b4d5613827394c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273945 expref: 22 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846311.689146:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3600, rc 0) 00000100:00100000:3.0:1788846311.689216:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:22644:x1875740702536448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846311.689223:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788846311.698672:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846311.698711:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273945 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827394c expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.698724:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273945 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827394c expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846311.698827:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.698890:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846311.698937:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846311.699260:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702536576 00000100:00100000:3.0:1788846311.699268:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702536576 00000100:00100000:3.0:1788846311.699327:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788846311.699336:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:22644:x1875740702536576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846311.699461:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:22644:x1875740702536576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846311.699485:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788846311.700347:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.700408:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.700462:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846311.700496:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846311.700805:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702536704 00000100:00100000:3.0:1788846311.700811:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702536704 00000100:00100000:3.0:1788846311.700852:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788846311.700860:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:22644:x1875740702536704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846311.700995:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:22644:x1875740702536704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846311.701003:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788846311.701231:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788846311.710094:0:25691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788846311.710320:0:22644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788846311.710346:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788846311.710356:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273945 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827394c expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.710368:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342aab000/0x21b4d56138273945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827394c expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846311.710378:0:22644:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788846311.710381:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e47b586000 from 13 10000000:01000000:2.0:1788846311.710385:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788846311.710421:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138273953 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.710429:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138273953 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.710439:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138273953 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846311.710461:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.710560:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846311.710602:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788846311.710911:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702536832 00000100:00100000:1.0:1788846311.710919:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702536832 00000100:00100000:1.0:1788846311.711214:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788846311.711227:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+22:22644:x1875740702536832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846311.711241:0:22640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846311.711255:0:22640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46f359c00/0x21b4d5613827395a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273953 expref: -99 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846311.711277:0:22640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46f359c00/0x21b4d5613827395a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273953 expref: 23 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846311.711287:0:22640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46f359c00/0x21b4d5613827395a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273953 expref: 23 pid: 22640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846311.711295:0:22640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f359c00, rc 0) 00000100:00100000:1.0:1788846311.711931:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:22644:x1875740702536832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 706us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846311.711939:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788846311.712326:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846311.712344:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138273953 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827395a expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.712368:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138273953 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827395a expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846311.712437:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.712471:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846311.712506:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846311.712689:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702536960 00000100:00100000:3.0:1788846311.712694:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702536960 00000100:00100000:3.0:1788846311.712737:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788846311.712745:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e468f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:22644:x1875740702536960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846311.712862:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e468f9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:22644:x1875740702536960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846311.712869:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788846311.713230:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702536960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.713263:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702537088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.713324:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846311.713352:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846311.713552:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702537088 00000100:00100000:3.0:1788846311.713557:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702537088 00000100:00100000:3.0:1788846311.713581:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788846311.713587:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:22644:x1875740702537088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846311.713677:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:22644:x1875740702537088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846311.713685:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788846311.715096:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702537088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788846311.720267:0:25692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788846311.721241:0:22644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788846311.721268:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788846311.721279:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138273953 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827395a expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.721292:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138273953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827395a expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846311.721472:0:22644:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788846311.721474:0:22644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e474598800 from 13 10000000:01000000:2.0:1788846311.721477:0:22644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788846311.721515:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaaa00/0x21b4d56138273961 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.721560:0:22644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342aaaa00/0x21b4d56138273961 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.721585:0:22644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342aaaa00/0x21b4d56138273961 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846311.721609:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702537216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.721685:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846311.721834:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846311.722081:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702537216 00000100:00100000:3.0:1788846311.722089:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702537216 00000100:00100000:3.0:1788846311.722140:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788846311.722150:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+23:22644:x1875740702537216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846311.722168:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846311.722181:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138273968 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273961 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846311.722203:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138273968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273961 expref: 24 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846311.722213:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138273968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273961 expref: 24 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846311.722221:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2c00, rc 0) 00000100:00100000:3.0:1788846311.722269:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:22644:x1875740702537216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846311.722276:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788846311.724480:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702537216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846311.724504:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342aaaa00/0x21b4d56138273961 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273968 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.724516:0:22644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342aaaa00/0x21b4d56138273961 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273968 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846311.724866:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702537344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.724925:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846311.725042:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702537344 00000100:00100000:1.0:1788846311.725056:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702537344 00000100:00100000:1.0:1788846311.725099:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788846311.725108:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:22644:x1875740702537344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846311.725224:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:22644:x1875740702537344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846311.725231:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788846311.725277:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788846311.725290:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702537344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.725431:0:22644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702537472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846311.725471:0:22644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846311.725483:0:22644:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846311.725556:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702537472 00000100:00100000:3.0:1788846311.725561:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702537472 00000100:00100000:3.0:1788846311.725585:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788846311.725591:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:22644:x1875740702537472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846311.725675:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:22644:x1875740702537472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846311.725682:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788846311.726168:0:22644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:22644:1875740702537472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788846311.729960:0:25693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788846311.730472:0:22644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788846311.730497:0:22644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788846311.730508:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaaa00/0x21b4d56138273961 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273968 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846311.730910:0:22644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342aaaa00/0x21b4d56138273961 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273968 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846312.076693:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846312.077068:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683560832 00000100:00100000:2.0:1788846312.077078:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683560832 00000100:00100000:2.0:1788846312.077151:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:2.0:1788846312.077162:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:18720:x1875740683560832:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846312.077182:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846312.077274:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d5613827396f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754bc0 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077339:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d56138273976 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788846312.077340:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788846312.077356:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d56138273976 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077368:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d56138273976 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077382:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d5613827397d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077389:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d5613827397d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077396:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d5613827397d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077658:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaae00/0x21b4d56138273984 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077668:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaae00/0x21b4d56138273984 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077677:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaae00/0x21b4d56138273984 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846312.077709:0:22649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788846312.077712:0:22649:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846312.077748:0:22649:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaae00/0x21b4d56138273984 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077758:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d56138273976 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077765:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d56138273976 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077772:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d56138273976 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077778:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846312.077783:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d56138273976 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077790:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d56138273976 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077801:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451777100) 00010000:00010000:2.0:1788846312.077810:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846312.077814:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d56138273976 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077819:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d56138273976 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077834:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d5613827397d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077839:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d5613827397d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077845:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d5613827397d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077849:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aabc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846312.077852:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d5613827397d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077857:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d5613827397d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077864:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90e3437a7500) 00010000:00010000:2.0:1788846312.077867:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846312.077869:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d5613827397d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.077874:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d5613827397d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.078272:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d5613827396f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bc0 expref: 8 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.078302:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaae00/0x21b4d56138273984 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bc0 expref: 7 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.078309:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90e3437a7600) 00010000:00010000:2.0:1788846312.078311:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846312.078314:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaae00, rc 0) 00000100:00100000:2.0:1788846312.078439:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:18720:x1875740683560832:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1278us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846312.078447:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1788846312.088616:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846312.088944:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683560960 00000100:00100000:1.0:1788846312.088953:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683560960 00000100:00100000:1.0:1788846312.089013:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:1.0:1788846312.089024:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:18720:x1875740683560960:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788846312.089107:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:18720:x1875740683560960:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 Request processed in 84us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.089115:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1788846312.092770:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.092857:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683561216 00000100:00100000:3.0:1788846312.092866:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683561216 00000100:00100000:3.0:1788846312.093462:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1788846312.093482:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:18720:x1875740683561216:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846312.093555:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846312.093575:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2400/0x21b4d5613827398b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754bc7 expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.093644:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138273992 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.093658:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138273992 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.093669:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138273992 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.093683:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138273999 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.093689:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138273999 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.093696:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138273999 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.093796:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382739a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.093805:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382739a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.093812:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382739a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846312.093821:0:22647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788846312.094008:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138273992 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094026:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138273992 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094033:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138273992 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094039:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846312.094053:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138273992 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094061:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138273992 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094074:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90e3437a7600) 00010000:00010000:3.0:1788846312.094077:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846312.094082:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138273992 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094088:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138273992 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094100:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138273999 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094105:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138273999 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094110:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138273999 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094124:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846312.094128:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138273999 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094134:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138273999 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094142:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90e342aa2200) 00010000:00010000:3.0:1788846312.094145:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846312.094148:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138273999 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.094153:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138273999 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.105547:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2400/0x21b4d5613827398b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bc7 expref: 10 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.105577:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382739a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bc7 expref: 9 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.105587:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e342aa2100) 00010000:00010000:2.0:1788846312.105590:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846312.105594:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2e00, rc 0) 00000100:00100000:2.0:1788846312.105667:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+9:18720:x1875740683561216:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 12187us (12906us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788846312.105675:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:2.0:1788846312.115752:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846312.115942:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683561344 00000100:00100000:0.0:1788846312.115952:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683561344 00000100:00100000:0.0:1788846312.116010:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1788846312.116020:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+9:18720:x1875740683561344:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788846312.116161:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+9:18720:x1875740683561344:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 142us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846312.116168:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1788846312.123660:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846312.123735:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683561472 00000100:00100000:2.0:1788846312.123745:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683561472 00000100:00100000:2.0:1788846312.123829:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:2.0:1788846312.123841:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:18720:x1875740683561472:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788846312.124900:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788846312.133111:0:22647:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9214us 00000100:00100000:2.0:1788846312.170772:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:18720:x1875740683561472:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 46926us (47113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846312.170786:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:1.0:1788846312.197690:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846312.198689:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683561600 00000100:00100000:2.0:1788846312.198700:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683561600 00000100:00100000:2.0:1788846312.198768:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:2.0:1788846312.198778:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+9:18726:x1875740683561600:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846312.204748:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846312.204779:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754bce expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205218:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205234:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205247:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205262:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205268:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205274:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205330:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205336:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205342:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205347:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aabc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846312.205351:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205358:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205370:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451777100) 00010000:00010000:2.0:1788846312.205373:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846312.205377:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205383:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205975:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205982:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.205989:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.206002:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846312.206006:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.206466:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.206479:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90e3437a7500) 00010000:00010000:2.0:1788846312.206482:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846312.206486:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.206492:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.206647:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bce expref: 10 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.206659:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451777100) 00010000:00010000:2.0:1788846312.206662:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846312.206666:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bce expref: 10 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.206679:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa000, rc 0) 00000100:00100000:0.0:1788846312.208348:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+9:18726:x1875740683561600:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 9560us (10656us total) trans 0 rc 301/301 00000100:00100000:0.0:1788846312.208359:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1788846312.215957:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846312.217850:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683561728 00000100:00100000:2.0:1788846312.217863:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683561728 00000100:00100000:2.0:1788846312.217925:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:2.0:1788846312.217935:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+9:18726:x1875740683561728:12345-192.168.203.20@tcp:700:lfs.0 00000100:00100000:2.0:1788846312.218060:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+9:18726:x1875740683561728:12345-192.168.203.20@tcp:700:lfs.0 Request processed in 126us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846312.218067:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1788846312.222246:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846312.222559:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683561984 00000100:00100000:2.0:1788846312.222569:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683561984 00000100:00100000:2.0:1788846312.222626:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1788846312.222636:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+9:18726:x1875740683561984:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:2.0:1788846312.222694:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846312.222720:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d561382738ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754b49 expref: 9 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.222738:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451777100) 00010000:00010000:2.0:1788846312.222753:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846312.222824:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.222839:0:22647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bb9 expref: 5 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.222847:0:22647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.222880:0:22647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bb9 expref: 5 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.222893:0:22647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bb9 expref: 5 pid: 22648 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846312.222924:0:22647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22647:1875740702537600:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846312.222995:0:22647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846312.229327:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846312.229442:0:22647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22647:1875740702537600:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846312.229472:0:22647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846312.229677:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683562112 00000100:00100000:3.0:1788846312.229684:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683562112 00010000:00010000:3.0:1788846312.229748:0:22633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bb9 expref: 6 pid: 22648 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846312.229794:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1788846312.229811:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+6:2398:x1875740683562112:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846312.229826:0:22633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846312.229832:0:22633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bb9 expref: 6 pid: 22648 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.229863:0:22633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bb9 expref: 6 pid: 22648 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.229885:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138273929 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bb9 expref: 6 pid: 22648 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.229900:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451777100) 00010000:00010000:3.0:1788846312.229905:0:22633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.229912:0:22633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.229919:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.229948:0:22633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846312.230000:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2398:x1875740683562112:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 197us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.230007:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00010000:00010000:2.0:1788846312.230251:0:22647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.230260:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.230283:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.230293:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.230306:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788846312.230957:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788846312.237281:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.237302:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.237313:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788846312.237340:0:22647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4bd9bc8 reply state 00000000e2b24705 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.237352:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.237359:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90e3437a7c00) 00010000:00010000:2.0:1788846312.237361:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788846312.237365:0:22647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788846312.237371:0:22647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788846312.237378:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.237383:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.237390:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.237396:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846312.237400:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.237408:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.237418:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451777100) 00010000:00010000:2.0:1788846312.237420:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846312.237423:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.237437:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d561382739c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788846312.239279:0:22647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4bd9bc8 reply state 00000000e2b24705 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.239295:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846312.239304:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90e3437a7500) 00010000:00010000:2.0:1788846312.239308:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788846312.239311:0:22647:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788846312.255594:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+10:18726:x1875740683561984:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 32950us (33348us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788846312.255607:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00010000:00010000:1.0:1788846312.313850:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846312.376906:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.376984:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683562240 00000100:00100000:3.0:1788846312.376994:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683562240 00000100:00100000:3.0:1788846312.377066:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:3.0:1788846312.377076:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+10:18734:x1875740683562240:12345-192.168.203.20@tcp:101:lctl.0 00010000:00010000:3.0:1788846312.377099:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846312.377121:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382739d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754bd5 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.377203:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382739df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.377216:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382739df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.377226:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382739df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846312.377270:0:22648:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788846312.377273:0:22648:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846312.377310:0:22648:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382739df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.377333:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382739d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bd5 expref: 12 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.377350:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382739df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bd5 expref: 11 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.377359:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2200) 00010000:00010000:3.0:1788846312.377361:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788846312.377365:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3400, rc 0) 00000100:00100000:3.0:1788846312.377425:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+11:18734:x1875740683562240:12345-192.168.203.20@tcp:101:lctl.0 Request processed in 350us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.377433:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:0.0:1788846312.416633:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846312.417212:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683562368 00000100:00100000:1.0:1788846312.417224:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683562368 00000100:00100000:1.0:1788846312.417287:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1788846312.417297:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+5:18735:x1875740683562368:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846312.417316:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846312.417333:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359400/0x21b4d561382739e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754bdc expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.417402:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359a00/0x21b4d561382739ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.417433:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359a00/0x21b4d561382739ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.417445:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359a00/0x21b4d561382739ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846312.417490:0:22647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788846312.417494:0:22647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788846312.417511:0:22647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359a00/0x21b4d561382739ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.417565:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359400/0x21b4d561382739e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bdc expref: 7 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.417583:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359a00/0x21b4d561382739ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bdc expref: 6 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.417592:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2200) 00010000:00010000:1.0:1788846312.417595:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788846312.417598:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f359a00, rc 0) 00000100:00100000:1.0:1788846312.417738:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+6:18735:x1875740683562368:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 441us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.417745:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1788846312.428225:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846312.428325:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683562496 00000100:00100000:0.0:1788846312.428334:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683562496 00000100:00100000:0.0:1788846312.428720:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:0.0:1788846312.428731:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+6:18735:x1875740683562496:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846312.428752:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846312.428775:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d561382739f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754be3 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.428835:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d561382739fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.428862:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d561382739fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.428874:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d561382739fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.428887:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.428895:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.428902:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.428974:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273a09 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.428981:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273a09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.428988:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273a09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846312.429148:0:22649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788846312.429153:0:22649:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846312.429176:0:22649:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273a09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429188:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d561382739fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429203:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d561382739fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429210:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d561382739fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429216:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846312.429220:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d561382739fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429228:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d561382739fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429241:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2200) 00010000:00010000:0.0:1788846312.429244:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846312.429248:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d561382739fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429255:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d561382739fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429268:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429274:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429280:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429285:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846312.429294:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429301:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429310:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90e3437a7500) 00010000:00010000:0.0:1788846312.429312:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846312.429315:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429321:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429347:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d561382739f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754be3 expref: 8 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429360:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273a09 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754be3 expref: 7 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.429367:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90e3437a7c00) 00010000:00010000:0.0:1788846312.430126:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788846312.430133:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f2800, rc 0) 00000100:00100000:0.0:1788846312.430208:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+7:18735:x1875740683562496:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1476us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846312.430216:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:0.0:1788846312.435028:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.435112:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683562624 00000100:00100000:3.0:1788846312.435122:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683562624 00000100:00100000:3.0:1788846312.435200:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:3.0:1788846312.435209:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02f36bf9-fda5-4feb-9347-af042b323ea9+5:18735:x1875740683562624:12345-192.168.203.20@tcp:900:lfs.0 00000100:00100000:3.0:1788846312.435287:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:02f36bf9-fda5-4feb-9347-af042b323ea9+5:18735:x1875740683562624:12345-192.168.203.20@tcp:900:lfs.0 Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.435295:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00080000:0.0:1788846312.435506:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846312.437909:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846312.437974:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683562880 00000100:00100000:1.0:1788846312.437984:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683562880 00000100:00100000:1.0:1788846312.438056:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:1.0:1788846312.438066:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+7:18735:x1875740683562880:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846312.438100:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846312.438121:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359400/0x21b4d56138273a10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754bea expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846312.438221:0:22647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788846312.438322:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359400/0x21b4d56138273a10 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bea expref: 9 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.438336:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2200) 00010000:00010000:1.0:1788846312.438339:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788846312.438344:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359400/0x21b4d56138273a10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bea expref: 9 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.438358:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f359400, rc 0) 00000100:00100000:1.0:1788846312.438429:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+8:18735:x1875740683562880:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 364us (527us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1788846312.438436:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:3.0:1788846312.442619:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846312.442704:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683563136 00000100:00100000:0.0:1788846312.442713:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683563136 00000100:00100000:0.0:1788846312.442772:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1788846312.442781:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+8:18735:x1875740683563136:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:0.0:1788846312.442843:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846312.442868:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273a09 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754be3 expref: 8 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.442887:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90e3437a7c00) 00010000:00010000:0.0:1788846312.442891:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846312.442911:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.442925:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.442934:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846312.443124:0:22649:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa6fb170 reply state 000000008479f7d2 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.443137:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.443143:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90e3437a7c00) 00010000:00010000:0.0:1788846312.443146:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788846312.443148:0:22649:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788846312.443156:0:22649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788846312.443229:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+9:18735:x1875740683563136:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 448us (617us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788846312.443237:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1788846312.446455:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846312.446635:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683563392 00000100:00100000:1.0:1788846312.446645:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683563392 00000100:00100000:1.0:1788846312.446707:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:1.0:1788846312.446719:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+9:18735:x1875740683563392:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1788846312.446941:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+10:18735:x1875740683563392:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 223us (493us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788846312.446948:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:3.0:1788846312.449906:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846312.449991:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683563648 00000100:00100000:0.0:1788846312.450002:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683563648 00000100:00100000:0.0:1788846312.450068:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:0.0:1788846312.450078:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+10:18735:x1875740683563648:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846312.450100:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846312.450118:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273a25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754bf1 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450186:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450200:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450211:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450221:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450228:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450234:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846312.450329:0:22648:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788846312.450395:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450401:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a2c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450420:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450426:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846312.450430:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450438:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450449:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2200) 00010000:00010000:0.0:1788846312.450452:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846312.450456:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450463:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450476:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450481:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450486:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450491:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846312.450493:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450508:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450516:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90e3437a7500) 00010000:00010000:0.0:1788846312.450559:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846312.450563:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450569:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450611:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273a25 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bf1 expref: 12 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450622:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2200) 00010000:00010000:0.0:1788846312.450625:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788846312.450628:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273a25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bf1 expref: 12 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.450639:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f2800, rc 0) 00000100:00100000:0.0:1788846312.450699:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+11:18735:x1875740683563648:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 623us (801us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788846312.450706:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:3.0:1788846312.458803:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846312.459000:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683563776 00000100:00100000:0.0:1788846312.459009:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683563776 00000100:00100000:0.0:1788846312.459079:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:0.0:1788846312.459091:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+11:18735:x1875740683563776:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846312.459130:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846312.459149:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a41 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754bf8 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.459240:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.459255:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.459265:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846312.459290:0:22649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788846312.459293:0:22649:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846312.459311:0:22649:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.459338:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273a41 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bf8 expref: 13 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.459358:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bf8 expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.459365:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90e3437a7c00) 00010000:00010000:0.0:1788846312.459368:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788846312.459371:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f2000, rc 0) 00000100:00100000:0.0:1788846312.459434:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+12:18735:x1875740683563776:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 346us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846312.459441:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:2.0:1788846312.462449:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.462801:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683563904 00000100:00100000:3.0:1788846312.462812:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683563904 00000100:00100000:3.0:1788846312.462901:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:3.0:1788846312.462912:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+12:18735:x1875740683563904:12345-192.168.203.20@tcp:37:lfs.0 00000100:00100000:3.0:1788846312.467108:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+12:18735:x1875740683563904:12345-192.168.203.20@tcp:37:lfs.0 Request processed in 4187us (4655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.467122:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:0.0:1788846312.471085:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846312.471184:0:25444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683564160 00000100:00100000:2.0:1788846312.471193:0:25444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683564160 00000100:00100000:2.0:1788846312.471280:0:25444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:2.0:1788846312.471291:0:25444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+12:18735:x1875740683564160:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846312.471508:0:25444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+13:18735:x1875740683564160:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 218us (498us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788846312.471516:0:25444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:2.0:1788846312.503588:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.503762:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683564288 00000100:00100000:3.0:1788846312.503772:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683564288 00000100:00100000:3.0:1788846312.503820:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:3.0:1788846312.503829:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+11:18099:x1875740683564288:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846312.503845:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846312.503862:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2800/0x21b4d56138273a4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754bff expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.503889:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2800/0x21b4d56138273a4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bff expref: 12 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.503916:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2800/0x21b4d56138273a4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bff expref: 12 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.503927:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2800, rc 0) 00000100:00100000:3.0:1788846312.503990:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+12:18099:x1875740683564288:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 161us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.503997:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:3.0:1788846312.507398:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846312.507562:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683564416 00000100:00100000:1.0:1788846312.507571:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683564416 00000100:00100000:1.0:1788846312.507618:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:1.0:1788846312.507638:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+12:18099:x1875740683564416:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846312.507773:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+12:18099:x1875740683564416:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 136us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.507781:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:1.0:1788846312.513290:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846312.513385:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683564544 00000100:00100000:0.0:1788846312.513395:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683564544 00000100:00100000:0.0:1788846312.513447:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:0.0:1788846312.513456:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+12:18099:x1875740683564544:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788846312.513652:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+12:18099:x1875740683564544:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 196us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846312.513660:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:2.0:1788846312.518361:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.518517:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683564672 00000100:00100000:3.0:1788846312.518620:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683564672 00000100:00100000:3.0:1788846312.518761:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:3.0:1788846312.518772:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+12:18099:x1875740683564672:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846312.518789:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846312.518806:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138273a56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c06 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.518834:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138273a56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c06 expref: 13 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.518845:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138273a56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c06 expref: 13 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.518854:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3a00, rc 0) 00000100:00100000:3.0:1788846312.518911:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18099:x1875740683564672:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 142us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.518918:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:3.0:1788846312.523849:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846312.524121:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683564800 00000100:00100000:1.0:1788846312.524130:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683564800 00000100:00100000:1.0:1788846312.524227:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:1.0:1788846312.524238:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18099:x1875740683564800:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846312.524438:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18099:x1875740683564800:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 201us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.524447:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:1.0:1788846312.539947:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.540708:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683564928 00000100:00100000:3.0:1788846312.540718:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683564928 00000100:00100000:3.0:1788846312.540844:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:3.0:1788846312.540855:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18099:x1875740683564928:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846312.540996:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:18099:x1875740683564928:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 142us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.541003:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:2.0:1788846312.585902:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846312.586128:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683565056 00000100:00100000:1.0:1788846312.586138:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683565056 00000100:00100000:1.0:1788846312.586204:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:1.0:1788846312.586214:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+11:18743:x1875740683565056:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1788846312.586236:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846312.586256:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273a5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c0d expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586321:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273a64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586336:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273a64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586365:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273a64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586378:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273a6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586385:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586392:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586473:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359400/0x21b4d56138273a72 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586636:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359400/0x21b4d56138273a72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586645:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359400/0x21b4d56138273a72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846312.586678:0:22647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788846312.586682:0:22647:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788846312.586720:0:22647:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359400/0x21b4d56138273a72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586731:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273a64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586737:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273a64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586755:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273a64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586761:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846312.586765:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273a64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586772:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273a64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586785:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2200) 00010000:00010000:1.0:1788846312.586788:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846312.586793:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273a64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586799:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273a64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586811:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586818:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273a6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586823:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273a6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586829:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846312.586832:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273a6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586848:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273a6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586856:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90e3437a7500) 00010000:00010000:1.0:1788846312.586858:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846312.586862:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273a6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586867:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273a6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586893:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273a5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c0d expref: 13 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586905:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359400/0x21b4d56138273a72 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c0d expref: 12 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.586912:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90e3437a7c00) 00010000:00010000:1.0:1788846312.586915:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788846312.586917:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f359400, rc 0) 00000100:00100000:1.0:1788846312.586976:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+12:18743:x1875740683565056:12345-192.168.203.20@tcp:101:bash.0 Request processed in 763us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.586984:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:1.0:1788846312.595639:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.595729:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683565184 00000100:00100000:3.0:1788846312.595739:0:22658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683565184 00000100:00100000:3.0:1788846312.595795:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1788846312.595805:0:22658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:18743:x1875740683565184:12345-192.168.203.20@tcp:900:bash.0 00000100:00100000:3.0:1788846312.595887:0:22658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:18743:x1875740683565184:12345-192.168.203.20@tcp:900:bash.0 Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.595895:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1788846312.598119:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.598244:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683565440 00000100:00100000:3.0:1788846312.598253:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683565440 00000100:00100000:3.0:1788846312.598306:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:3.0:1788846312.598314:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+12:18743:x1875740683565440:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846312.598330:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846312.598348:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2600/0x21b4d56138273a79 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c14 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.598445:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.598460:0:22648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bf8 expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.598492:0:22648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.598574:0:22648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bf8 expref: 12 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.598589:0:22648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bf8 expref: 12 pid: 22649 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846312.598603:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f35ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22648:1875740702537728:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846312.598680:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b5fdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846312.601282:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f35ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22648:1875740702537728:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846312.601312:0:22648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846312.601808:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846312.602108:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683565568 00000100:00100000:1.0:1788846312.602116:0:22634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683565568 00010000:00010000:1.0:1788846312.602150:0:22634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bf8 expref: 13 pid: 22649 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846312.602201:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1788846312.602210:0:22634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+13:2399:x1875740683565568:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846312.602224:0:22634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846312.602230:0:22634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bf8 expref: 13 pid: 22649 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.602242:0:22634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bf8 expref: 13 pid: 22649 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.602262:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273a48 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754bf8 expref: 13 pid: 22649 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.602277:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90e3437a7c00) 00010000:00010000:1.0:1788846312.602282:0:22634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.602293:0:22634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.602300:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.602359:0:22634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846312.602405:0:22634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f36bf9-fda5-4feb-9347-af042b323ea9+12:2399:x1875740683565568:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 197us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.602412:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00010000:00010000:3.0:1788846312.605174:0:22648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605191:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605253:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605264:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605274:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605825:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273a8e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605836:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273a8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605844:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273a8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846312.605855:0:22648:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788846312.605880:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605886:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605893:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605899:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846312.605903:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605910:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605921:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90e3437a7c00) 00010000:00010000:3.0:1788846312.605924:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846312.605928:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605948:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2000/0x21b4d56138273a80 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788846312.605961:0:22648:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075ce178a reply state 000000005c0c0683 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605971:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.605977:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90e342aa2d00) 00010000:00010000:3.0:1788846312.605980:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788846312.605983:0:22648:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788846312.606731:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2600/0x21b4d56138273a79 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c14 expref: 15 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.606751:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273a8e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c14 expref: 14 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.606760:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:3.0:1788846312.606762:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788846312.606764:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3e00, rc 0) 00000100:00100000:3.0:1788846312.606890:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+15:18743:x1875740683565440:12345-192.168.203.20@tcp:101:bash.0 Request processed in 8575us (8778us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788846312.606899:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:2.0:1788846312.630822:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846312.633276:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683565696 00000100:00100000:0.0:1788846312.633291:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683565696 00000100:00100000:0.0:1788846312.633405:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:0.0:1788846312.633416:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+15:18743:x1875740683565696:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1788846312.633439:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846312.633459:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a9c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c1b expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.633570:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.633583:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.633593:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846312.633638:0:22649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788846312.633642:0:22649:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846312.633662:0:22649:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.633690:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.633713:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273a9c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c1b expref: 17 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.633731:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c1b expref: 16 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.633739:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:0.0:1788846312.633742:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846312.633745:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f2000, rc 0) 00000100:00100000:0.0:1788846312.633810:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+16:18743:x1875740683565696:12345-192.168.203.20@tcp:101:bash.0 Request processed in 396us (3000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846312.633818:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:2.0:1788846312.638322:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.638428:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683565952 00000100:00100000:3.0:1788846312.638439:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683565952 00000100:00100000:3.0:1788846312.638512:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:3.0:1788846312.638547:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+16:18743:x1875740683565952:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1788846312.638822:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+17:18743:x1875740683565952:12345-192.168.203.20@tcp:35:bash.0 Request processed in 301us (510us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788846312.638830:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000040:00080000:1.0:1788846312.698241:0:23400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788846312.745743:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846312.745898:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683566208 00000100:00100000:0.0:1788846312.745908:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683566208 00000100:00100000:0.0:1788846312.745969:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:0.0:1788846312.745978:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+17:18753:x1875740683566208:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846312.746001:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846312.746022:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273aaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c22 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846312.746126:0:22648:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788846312.746223:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273aaa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c22 expref: 19 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.746254:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2200) 00010000:00010000:0.0:1788846312.746257:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788846312.746262:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273aaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c22 expref: 19 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846312.746275:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f3000, rc 0) 00000100:00100000:0.0:1788846312.746625:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+18:18753:x1875740683566208:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 647us (890us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788846312.746633:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1788846312.750738:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.751078:0:25444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683566464 00000100:00100000:3.0:1788846312.751088:0:25444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683566464 00000100:00100000:3.0:1788846312.751168:0:25444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:3.0:1788846312.751178:0:25444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+18:18753:x1875740683566464:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1788846312.751382:0:25444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+19:18753:x1875740683566464:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 205us (652us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1788846312.751391:0:25444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1788846312.761770:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702537856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846312.761853:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846312.761998:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702537856 00000100:00100000:0.0:1788846312.762005:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702537856 00000100:00100000:0.0:1788846312.762079:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788846312.762089:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702537856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788846312.762117:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788846312.762159:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702537856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846312.762166:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788846312.762280:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788846312.762319:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702537856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788846312.762584:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702538112:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.762618:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.762637:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702538624:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.762660:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.762675:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47678b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702539136:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.762697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.762717:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788846312.762722:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702538240:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.762745:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.762759:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702538752:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.762776:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.762788:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e476789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702539264:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.762806:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.762830:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702538368:0@lo:400:kworker.0 00000100:00100000:1.0:1788846312.762941:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702538112 00000100:00100000:1.0:1788846312.762946:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702538112 00000100:00100000:1.0:1788846312.762979:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788846312.762987:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e476789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702538112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846312.763054:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e476789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702538112:12345-0@lo:400:kworker.0 Request processed in 68us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.763061:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788846312.763092:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702538112:0@lo:400:kworker.0 00000100:00100000:1.0:1788846312.763111:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702539136 00000100:00100000:1.0:1788846312.763114:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702539136 00000100:00080000:1.0:1788846312.763129:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788846312.763152:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702539264 00000100:00100000:1.0:1788846312.763155:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702539264 00000100:00080000:1.0:1788846312.763165:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846312.763176:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788846312.763181:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e476788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702539136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846312.763211:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e476788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702539136:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.763216:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788846312.763235:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47678b480 x1875740702539136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846312.763245:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47678b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702539136:0@lo:400:kworker.0 00000100:00100000:1.0:1788846312.763272:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788846312.763277:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47678a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702539264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846312.763304:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47678a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702539264:12345-0@lo:400:kworker.0 Request processed in 27us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.763309:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788846312.763326:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e476789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702539264:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.763578:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.763604:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702538880:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.763625:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.763638:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47678a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702539392:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.763656:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.763668:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788846312.763674:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702537984:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.763696:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.763715:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702538496:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.763731:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.763752:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e476789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702539008:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.763780:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846312.763891:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702538624 00000100:00100000:3.0:1788846312.763896:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702538624 00000100:00100000:3.0:1788846312.763928:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702538240 00000100:00100000:3.0:1788846312.763930:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702538240 00000100:00100000:3.0:1788846312.763939:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702538752 00000100:00100000:3.0:1788846312.763941:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702538752 00000100:00100000:3.0:1788846312.763954:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788846312.763960:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47678ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702538624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846312.763995:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47678ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702538624:12345-0@lo:400:kworker.0 Request processed in 36us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.764001:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788846312.764164:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788846312.764171:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4768dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702538240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846312.764204:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4768dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702538240:12345-0@lo:400:kworker.0 Request processed in 34us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.764218:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788846312.764331:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788846312.764338:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e476788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702538752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846312.764365:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e476788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702538752:12345-0@lo:400:kworker.0 Request processed in 28us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.764371:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788846312.764394:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788846312.764397:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846312.764421:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702538240:0@lo:400:kworker.0 00000100:00100000:3.0:1788846312.764432:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702538752:0@lo:400:kworker.0 00000100:00100000:3.0:1788846312.764440:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702538624:0@lo:400:kworker.0 00000040:00080000:0.0:1788846312.765336:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846312.765405:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702538368 00000100:00100000:0.0:1788846312.765411:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702538368 00000100:00100000:0.0:1788846312.765439:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702538880 00000100:00100000:0.0:1788846312.765441:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702538880 00000100:00100000:0.0:1788846312.765454:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702539392 00000100:00100000:0.0:1788846312.765456:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702539392 00000100:00100000:0.0:1788846312.765491:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702539008 00000100:00100000:0.0:1788846312.765494:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702539008 00000100:00100000:0.0:1788846312.765511:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788846312.765556:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47678aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702538368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846312.765614:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47678aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702538368:12345-0@lo:400:kworker.0 Request processed in 61us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846312.765621:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788846312.765636:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788846312.765642:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47678bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702538880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846312.765668:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47678bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702538880:12345-0@lo:400:kworker.0 Request processed in 27us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846312.765674:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788846312.765686:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788846312.765691:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47678b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702539392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846312.765718:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47678b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702539392:12345-0@lo:400:kworker.0 Request processed in 27us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846312.765723:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788846312.765735:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788846312.765741:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e476789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702539008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846312.765770:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e476789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702539008:12345-0@lo:400:kworker.0 Request processed in 30us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846312.765775:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788846312.766001:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e476789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702539008:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.766095:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e448f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702538368:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.766106:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702538880:0@lo:400:kworker.0 00010000:00080000:2.0:1788846312.766119:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47678a300 x1875740702539392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846312.766129:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47678a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702539392:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.766148:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788846312.766158:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702539520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788846312.766192:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846312.766230:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702539520 00000100:00100000:2.0:1788846312.766234:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702539520 00000100:00100000:2.0:1788846312.766259:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788846312.766265:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47678a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702539520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788846312.766280:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788846312.766314:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47678a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702539520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846312.766320:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788846312.766350:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702539520:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788846312.766420:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788846312.766425:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788846312.766482:0:22640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702537984 00000100:00100000:1.0:1788846312.766486:0:22640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702537984 00000100:00100000:1.0:1788846312.766544:0:22640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788846312.766551:0:22640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3642:x1875740702537984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846312.766594:0:22640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3642:x1875740702537984:12345-0@lo:400:kworker.0 Request processed in 44us (2896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.766600:0:22640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788846312.766630:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702538496 00000100:00100000:1.0:1788846312.766633:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702538496 00000100:00100000:1.0:1788846312.766658:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788846312.766664:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e476789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702538496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846312.766694:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e476789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702538496:12345-0@lo:400:kworker.0 Request processed in 30us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.766699:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788846312.766959:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702537984:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.766969:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702538496:0@lo:400:kworker.0 00000100:00100000:2.0:1788846312.803481:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846312.804752:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683566720 00000100:00100000:0.0:1788846312.804764:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683566720 00000100:00100000:1.0:1788846312.805442:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:1.0:1788846312.805454:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e476789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+19:18756:x1875740683566720:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846312.805479:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846312.805499:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273ab8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c29 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.805651:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273abf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.805666:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273abf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.805678:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273abf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846312.805688:0:22648:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788846312.805787:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273ab8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c29 expref: 22 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.805806:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273abf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c29 expref: 21 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.805814:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:1.0:1788846312.805817:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846312.805821:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f358400, rc 0) 00000100:00100000:1.0:1788846312.806018:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e476789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+21:18756:x1875740683566720:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 566us (2544us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788846312.806026:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1788846312.809670:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846312.809736:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683566848 00000100:00100000:1.0:1788846312.809746:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683566848 00000100:00100000:1.0:1788846312.809805:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:1.0:1788846312.809815:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+21:18756:x1875740683566848:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1788846312.809890:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273acd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.809919:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273acd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.809930:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273acd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.809964:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273acd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.809971:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273acd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.809978:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273acd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.809984:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846312.809988:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273acd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.809995:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273acd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.810006:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:1.0:1788846312.810009:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788846312.810013:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273acd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846312.810020:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273acd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846312.810100:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+21:18756:x1875740683566848:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 285us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846312.810114:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:3.0:1788846312.811894:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846312.811978:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683567104 00000100:00100000:2.0:1788846312.811987:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683567104 00000100:00100000:2.0:1788846312.812045:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1788846312.812054:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+21:18756:x1875740683567104:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846312.812233:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+22:18756:x1875740683567104:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 180us (458us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788846312.812240:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1788846312.825187:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846312.825269:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683567232 00000100:00100000:3.0:1788846312.825279:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683567232 00000100:00100000:3.0:1788846312.825343:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1788846312.825354:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47678b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+22:2399:x1875740683567232:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846312.825379:0:22633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846312.825404:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358400/0x21b4d56138273abf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c29 expref: 22 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846312.825425:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:3.0:1788846312.825430:0:22633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846312.825497:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47678b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+21:2399:x1875740683567232:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846312.825518:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1788846313.161147:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846313.161386:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683567488 00000100:00100000:2.0:1788846313.161396:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683567488 00000100:00100000:2.0:1788846313.161459:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:2.0:1788846313.161470:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+21:18787:x1875740683567488:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:2.0:1788846313.161493:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846313.161512:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273ad4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c30 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.161654:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273adb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.161669:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273adb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.161683:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273adb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846313.161698:0:22649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788846313.161825:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273ad4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c30 expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.161862:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273adb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c30 expref: 23 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.161872:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:2.0:1788846313.161875:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846313.161878:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaac00, rc 0) 00000100:00100000:2.0:1788846313.161939:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+23:18787:x1875740683567488:12345-192.168.203.20@tcp:101:cat.0 Request processed in 471us (800us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788846313.161945:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:2.0:1788846313.168258:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.168310:0:25444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683567744 00000100:00100000:3.0:1788846313.168320:0:25444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683567744 00000100:00100000:3.0:1788846313.168379:0:25444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:3.0:1788846313.168390:0:25444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e476788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+23:18787:x1875740683567744:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:3.0:1788846313.168705:0:25444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e476788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+24:18787:x1875740683567744:12345-192.168.203.20@tcp:35:cat.0 Request processed in 315us (455us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788846313.168713:0:25444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:0.0:1788846313.176693:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846313.176795:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683567872 00000100:00100000:2.0:1788846313.176805:0:22634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683567872 00000100:00100000:2.0:1788846313.176881:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:2.0:1788846313.176892:0:22634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+24:2399:x1875740683567872:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846313.176907:0:22634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846313.176932:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273adb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c30 expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.176953:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:2.0:1788846313.176957:0:22634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846313.177020:0:22634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+23:2399:x1875740683567872:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 130us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.177027:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:0.0:1788846313.255126:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846313.255399:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683568128 00000100:00100000:1.0:1788846313.255410:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683568128 00000100:00100000:1.0:1788846313.255474:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:1.0:1788846313.255483:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+23:18793:x1875740683568128:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:1.0:1788846313.255506:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846313.255562:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273ae9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c37 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.255669:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273af0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.255684:0:22648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273a8e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c14 expref: 24 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.255692:0:22648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c1b expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.255699:0:22648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273af0 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.255728:0:22648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c1b expref: 24 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.255742:0:22648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c1b expref: 24 pid: 22649 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846313.255755:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22648:1875740702539648:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846313.255850:0:22648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273a8e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c14 expref: 24 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.255859:0:22648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273a8e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c14 expref: 24 pid: 22648 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846313.255869:0:22648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22648:1875740702539776:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846313.255889:0:22648:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788846313.261416:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22648:1875740702539776:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846313.261904:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.262205:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683568256 00000100:00100000:3.0:1788846313.262214:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683568256 00010000:00010000:3.0:1788846313.262250:0:22633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273a8e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c14 expref: 25 pid: 22648 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846313.262295:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1788846313.262305:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+25:2398:x1875740683568256:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846313.262318:0:22633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846313.262325:0:22633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273a8e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c14 expref: 25 pid: 22648 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.262336:0:22633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273a8e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c14 expref: 25 pid: 22648 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.262361:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273a8e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c14 expref: 25 pid: 22648 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.262376:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:3.0:1788846313.262389:0:22633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273af0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.262397:0:22633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273af0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.262403:0:22633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846313.262456:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+24:2398:x1875740683568256:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 152us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846313.262622:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1788846313.265135:0:22648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22648:1875740702539648:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846313.265167:0:22648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273af0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846313.267431:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846313.267678:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683568384 00000100:00100000:1.0:1788846313.267687:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683568384 00010000:00010000:1.0:1788846313.267726:0:22632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c1b expref: 24 pid: 22649 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846313.267779:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1788846313.267790:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+24:2398:x1875740683568384:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846313.267804:0:22632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846313.267811:0:22632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c1b expref: 24 pid: 22649 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.267824:0:22632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c1b expref: 24 pid: 22649 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.267876:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273aa3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c1b expref: 24 pid: 22649 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.267890:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:1.0:1788846313.267895:0:22632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273af0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.267903:0:22632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273af0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.267910:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273af0 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.267937:0:22632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846313.267988:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c71050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+23:2398:x1875740683568384:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 201us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846313.267999:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00010000:00010000:0.0:1788846313.268934:0:22648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273af0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.268946:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273af0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846313.268963:0:22648:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788846313.269330:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358600/0x21b4d56138273ae9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c37 expref: 24 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.269351:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358a00/0x21b4d56138273af0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c37 expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.269360:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:0.0:1788846313.269363:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788846313.269367:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f358a00, rc 0) 00000100:00100000:0.0:1788846313.269473:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+23:18793:x1875740683568128:12345-192.168.203.20@tcp:101:dd.0 Request processed in 13990us (14353us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788846313.269480:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:0.0:1788846313.278671:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846313.278753:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683568512 00000100:00100000:1.0:1788846313.278763:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683568512 00000100:00100000:1.0:1788846313.278824:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:1.0:1788846313.278835:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+23:18793:x1875740683568512:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:1.0:1788846313.278859:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846313.278878:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359000/0x21b4d56138273afe lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c3e expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.278917:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d56138273b05 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.278949:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d56138273b05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.278962:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d56138273b05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.279087:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359000/0x21b4d56138273afe lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c3e expref: 25 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.279105:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d56138273b05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c3e expref: 24 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.279114:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:1.0:1788846313.279117:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788846313.279120:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f358200, rc 0) 00000100:00100000:1.0:1788846313.279178:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+24:18793:x1875740683568512:12345-192.168.203.20@tcp:101:dd.0 Request processed in 344us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846313.279185:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:3.0:1788846313.284367:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846313.284713:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683568768 00000100:00100000:0.0:1788846313.284725:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683568768 00000100:00100000:0.0:1788846313.284818:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:0.0:1788846313.284828:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+24:18793:x1875740683568768:12345-192.168.203.20@tcp:36:dd.0 00010000:00010000:0.0:1788846313.285068:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.285086:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.285110:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788846313.285153:0:22648:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788846313.285178:0:22648:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee18f072 reply state 000000005d13e45c transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.285190:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.285197:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:0.0:1788846313.285200:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846313.285202:0:22648:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788846313.285330:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+27:18793:x1875740683568768:12345-192.168.203.20@tcp:36:dd.0 Request processed in 503us (972us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788846313.285338:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000020:00080000:0.0:1788846313.285343:0:22648:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788846313.292647:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846313.292843:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683568896 00000100:00100000:2.0:1788846313.292854:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683568896 00000100:00100000:2.0:1788846313.292931:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:2.0:1788846313.292941:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+27:18793:x1875740683568896:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:2.0:1788846313.292965:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846313.292986:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b13 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c45 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.293059:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b13 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c45 expref: 28 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.293076:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b13 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c45 expref: 28 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.293095:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:2.0:1788846313.293098:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788846313.293101:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaac00, rc 0) 00000100:00100000:2.0:1788846313.293158:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+28:18793:x1875740683568896:12345-192.168.203.20@tcp:101:dd.0 Request processed in 219us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.293165:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1788846313.307125:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846313.307368:0:23802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683569152 00000100:00100000:1.0:1788846313.307377:0:23802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683569152 00000100:00100000:1.0:1788846313.307437:0:23802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:1.0:1788846313.307447:0:23802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+28:18793:x1875740683569152:12345-192.168.203.20@tcp:103:dd.0 00010000:00010000:1.0:1788846313.307461:0:23802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846313.307484:0:23802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b13 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c45 expref: 28 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.307505:0:23802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:1.0:1788846313.307563:0:23802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846313.307617:0:23802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+27:18793:x1875740683569152:12345-192.168.203.20@tcp:103:dd.0 Request processed in 171us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846313.307625:0:23802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1788846313.312698:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846313.312886:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683569280 00000100:00100000:0.0:1788846313.312897:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683569280 00000100:00100000:0.0:1788846313.312955:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:0.0:1788846313.312966:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e476788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+27:18793:x1875740683569280:12345-192.168.203.20@tcp:58:dd.0 00010000:00010000:0.0:1788846313.313106:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.313124:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.313136:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788846313.327017:0:22648:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788846313.327063:0:22648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788846313.327325:0:22648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788846313.327431:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e476788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+27:18793:x1875740683569280:12345-192.168.203.20@tcp:58:dd.0 Request processed in 14462us (14737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846313.327442:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:2.0:1788846313.329626:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846313.329708:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683569408 00000100:00100000:1.0:1788846313.329718:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683569408 00000100:00100000:1.0:1788846313.329850:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:1.0:1788846313.329860:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e476788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+27:18793:x1875740683569408:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:1.0:1788846313.329879:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846313.329899:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359000/0x21b4d56138273b21 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c4c expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.329952:0:22647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.329963:0:22647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359000/0x21b4d56138273b21 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c4c expref: 28 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.329981:0:22647:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.329993:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359000/0x21b4d56138273b21 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c4c expref: 28 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.330006:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:1.0:1788846313.330079:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788846313.330083:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359000/0x21b4d56138273b21 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c4c expref: 28 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.330112:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f359000, rc 0) 00000100:00100000:1.0:1788846313.330173:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e476788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+28:18793:x1875740683569408:12345-192.168.203.20@tcp:101:dd.0 Request processed in 314us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846313.330180:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00010000:00010000:0.0:1788846313.337717:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846313.785755:0:22683:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788846313.785766:0:22683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788846313.785805:0:22683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788846313.785820:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788846313.785967:0:22683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22683:1875740702539904:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788846313.786081:0:22683:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3444209c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846313.791013:0:22683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22683:1875740702539904:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788846313.791622:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846313.791860:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683569536 00000100:00100000:0.0:1788846313.791869:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683569536 00000100:00100000:0.0:1788846313.791926:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:0.0:1788846313.791937:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+28:18794:x1875740683569536:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788846313.791967:0:22648:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788846313.792122:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+28:18794:x1875740683569536:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 186us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846313.792130:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:2.0:1788846313.798168:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846313.798356:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683569664 00000100:00100000:1.0:1788846313.798366:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683569664 00000100:00100000:1.0:1788846313.798427:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:1.0:1788846313.798437:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47678b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+28:18794:x1875740683569664:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788846313.798779:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358800/0x21b4d56138273b28 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.798796:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358800/0x21b4d56138273b28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.798809:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358800/0x21b4d56138273b28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.798933:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d56138273b2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.798943:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d56138273b2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.798951:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d56138273b2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.798974:0:22649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359600/0x21b4d56138273b36 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799082:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359600/0x21b4d56138273b36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799091:0:22649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359600/0x21b4d56138273b36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846313.799141:0:22649:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788846313.799146:0:22649:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788846313.799163:0:22649:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359600/0x21b4d56138273b36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799175:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358800/0x21b4d56138273b28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799182:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358800/0x21b4d56138273b28 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799189:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358800/0x21b4d56138273b28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799195:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846313.799199:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358800/0x21b4d56138273b28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799207:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358800/0x21b4d56138273b28 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799220:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e342aa2100) 00010000:00010000:1.0:1788846313.799224:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846313.799228:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358800/0x21b4d56138273b28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799322:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358800/0x21b4d56138273b28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799338:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d56138273b2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799345:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d56138273b2f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799350:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d56138273b2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799356:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846313.799359:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d56138273b2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799365:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d56138273b2f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799373:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff90e342864b00) 00010000:00010000:1.0:1788846313.799377:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846313.799380:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d56138273b2f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799385:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359e00/0x21b4d56138273b2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799398:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359600/0x21b4d56138273b36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799404:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359600/0x21b4d56138273b36 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799415:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359600/0x21b4d56138273b36 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799419:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846313.799422:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359600/0x21b4d56138273b36 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799427:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359600/0x21b4d56138273b36 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799434:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:1.0:1788846313.799437:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846313.799658:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359600/0x21b4d56138273b36 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.799668:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359600/0x21b4d56138273b36 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846313.799880:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47678b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+28:18794:x1875740683569664:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 1440us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846313.799890:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:3.0:1788846313.803282:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846313.803341:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683569920 00000100:00100000:1.0:1788846313.803351:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683569920 00000100:00100000:1.0:1788846313.803414:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:1.0:1788846313.803425:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+28:18794:x1875740683569920:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788846313.803462:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846313.803482:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c53 expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803649:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359800/0x21b4d56138273b44 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803665:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359800/0x21b4d56138273b44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803677:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359800/0x21b4d56138273b44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846313.803687:0:22647:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788846313.803761:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359800/0x21b4d56138273b44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803769:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359800/0x21b4d56138273b44 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803775:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359800/0x21b4d56138273b44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803782:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f359800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846313.803786:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359800/0x21b4d56138273b44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803793:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359800/0x21b4d56138273b44 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803804:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:1.0:1788846313.803807:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788846313.803812:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359800/0x21b4d56138273b44 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803828:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359800/0x21b4d56138273b44 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803869:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b3d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c53 expref: 30 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803879:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e342aa2100) 00010000:00010000:1.0:1788846313.803881:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788846313.803885:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c53 expref: 30 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.803894:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46f358c00, rc 0) 00000100:00100000:1.0:1788846313.804686:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+29:18794:x1875740683569920:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1259us (1408us total) trans 12884901907 rc 301/301 00000100:00100000:1.0:1788846313.804696:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1788846313.810322:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846313.810406:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683570048 00000100:00100000:1.0:1788846313.810417:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683570048 00000100:00100000:1.0:1788846313.810483:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:1.0:1788846313.810494:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+29:18794:x1875740683570048:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788846313.810719:0:22649:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788846313.810983:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+29:18794:x1875740683570048:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 489us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846313.810991:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:0.0:1788846313.818782:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846313.820212:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683570304 00000100:00100000:1.0:1788846313.820226:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683570304 00000100:00100000:0.0:1788846313.820919:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:0.0:1788846313.820930:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+29:18794:x1875740683570304:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846313.820966:0:22647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846313.820988:0:22647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273b52 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c5a expref: -99 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788846313.821780:0:22647:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:0.0:1788846313.821788:0:22647:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:0.0:1788846313.821803:0:22647:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1788846313.822076:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273b59 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.822094:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273b59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.822106:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273b59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.822171:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273b52 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c5a expref: 32 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.822188:0:22647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273b59 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c5a expref: 31 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.822197:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e45a2dc600) 00010000:00010000:0.0:1788846313.822201:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846313.822204:0:22647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f3000, rc 0) 00000100:00100000:0.0:1788846313.822391:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+31:18794:x1875740683570304:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1461us (3616us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1788846313.822400:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:3.0:1788846313.834725:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846313.835864:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683570560 00000100:00100000:2.0:1788846313.835877:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683570560 00000100:00100000:2.0:1788846313.835993:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:2.0:1788846313.836015:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+31:18794:x1875740683570560:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788846313.836107:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846313.836137:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273b59 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c5a expref: 31 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836168:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e45a2dc600) 00010000:00010000:2.0:1788846313.836181:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846313.836209:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b67 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836222:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b67 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836232:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b67 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836259:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b6e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6eaa0f75 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836265:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b6e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6eaa0f75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836271:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b6e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6eaa0f75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836315:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b67 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836321:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b67 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836328:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b67 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836334:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846313.836338:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b67 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836353:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b67 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836364:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90e3437a7c00) 00010000:00010000:2.0:1788846313.836367:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846313.836371:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b67 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836376:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b67 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836388:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b6e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6eaa0f75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836394:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b6e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6eaa0f75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836400:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b6e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6eaa0f75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836405:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaac00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846313.836408:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b6e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6eaa0f75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836413:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b6e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6eaa0f75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836419:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x6eaa0f75 (ffff90e3437a7800) 00010000:00010000:2.0:1788846313.836422:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846313.836424:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b6e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6eaa0f75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.836795:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b6e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6eaa0f75 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846313.836891:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+30:18794:x1875740683570560:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 877us (2174us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788846313.836898:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:3.0:1788846313.841920:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.841964:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.841995:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.842038:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.842063:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.842078:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.842102:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683571072 00000100:00100000:3.0:1788846313.842110:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683571072 00000100:00100000:3.0:1788846313.842164:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683571584 00000100:00100000:3.0:1788846313.842167:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683571584 00000100:00100000:3.0:1788846313.842191:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1788846313.842201:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2400:x1875740683571072:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846313.842303:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2400:x1875740683571072:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846313.842311:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1788846313.842328:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:3.0:1788846313.842335:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2400:x1875740683571584:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846313.842358:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2400:x1875740683571584:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846313.842363:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00080000:3.0:1788846313.842388:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788846313.842580:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683570816 00000100:00100000:2.0:1788846313.842586:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683570816 00000100:00100000:2.0:1788846313.842609:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683570944 00000100:00100000:2.0:1788846313.842612:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683570944 00000100:00100000:2.0:1788846313.842623:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683571328 00000100:00100000:2.0:1788846313.842625:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683571328 00000100:00100000:2.0:1788846313.842638:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1788846313.842645:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2400:x1875740683570944:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846313.842741:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2400:x1875740683570944:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 96us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.842748:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1788846313.842763:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:2.0:1788846313.843070:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+12:2400:x1875740683571328:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846313.843109:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+12:2400:x1875740683571328:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 339us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.843116:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:2.0:1788846313.843130:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:2.0:1788846313.843136:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+30:18794:x1875740683570816:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846313.843149:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846313.843191:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b75 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c61 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.843227:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273b7c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.843240:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273b7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.843251:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273b7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.843365:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b75 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c61 expref: 32 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.843385:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273b7c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c61 expref: 31 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.843394:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846313.843398:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788846313.843401:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aab400, rc 0) 00000100:00100000:2.0:1788846313.843431:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+31:18794:x1875740683570816:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 294us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.843437:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1788846313.843621:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683570688 00000100:00100000:0.0:1788846313.843633:0:22641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683570688 00000100:00100000:0.0:1788846313.843684:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:0.0:1788846313.843693:0:22641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:2400:x1875740683570688:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846313.843722:0:22641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9951a80c-fa2d-4708-bd9b-b743be3211e4+13:2400:x1875740683570688:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846313.843730:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:3.0:1788846313.844627:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.844709:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.844792:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.844851:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683571200 00000100:00100000:3.0:1788846313.844857:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683571200 00000100:00100000:3.0:1788846313.844896:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683571712 00000100:00100000:3.0:1788846313.844899:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683571712 00000100:00100000:3.0:1788846313.844921:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1788846313.844929:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2401:x1875740683571200:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846313.844978:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2401:x1875740683571200:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846313.844984:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1788846313.844998:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1788846313.845012:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2401:x1875740683571712:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846313.845046:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2401:x1875740683571712:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846313.845070:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00080000:3.0:1788846313.845097:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846313.845141:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683571456 00000100:00100000:2.0:1788846313.845147:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683571456 00000100:00100000:2.0:1788846313.845195:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:2.0:1788846313.845202:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2401:x1875740683571456:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846313.845240:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02f36bf9-fda5-4feb-9347-af042b323ea9+5:2401:x1875740683571456:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 39us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.845253:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:3.0:1788846313.854311:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846313.854435:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683571968 00000100:00100000:1.0:1788846313.854457:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683571968 00000100:00100000:1.0:1788846313.854609:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:1.0:1788846313.854620:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+31:18794:x1875740683571968:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788846313.854713:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.854729:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.854740:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788846313.854907:0:22647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1788846313.854918:0:22647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 697892396963ns, next at 698892394383ns, rc = 0 00000004:00010000:1.0:1788846313.854964:0:22647:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ed8e08c reply state 000000002df828b9 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.854977:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.854984:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:1.0:1788846313.854987:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788846313.854991:0:22647:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788846313.855102:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+33:18794:x1875740683571968:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 484us (799us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788846313.855109:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:0.0:1788846313.859753:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846313.861285:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683572096 00000100:00100000:2.0:1788846313.861299:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683572096 00000100:00100000:2.0:1788846313.861379:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:2.0:1788846313.861389:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+33:18794:x1875740683572096:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846313.861415:0:22649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846313.861435:0:22649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b8a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c68 expref: -99 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.861504:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b8a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c68 expref: 34 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.861554:0:22649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b8a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c68 expref: 34 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.861574:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846313.861836:0:22649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788846313.861842:0:22649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aab800, rc 0) 00000100:00100000:2.0:1788846313.861954:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+34:18794:x1875740683572096:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 566us (2209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.861961:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:3.0:1788846313.874187:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846313.874330:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683572224 00000100:00100000:0.0:1788846313.874340:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683572224 00000100:00100000:0.0:1788846313.874398:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:0.0:1788846313.874408:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2398:x1875740683572224:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788846313.874706:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2398:x1875740683572224:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 298us (527us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788846313.874714:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1788846313.890174:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846313.890280:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683572480 00000100:00100000:2.0:1788846313.890290:0:22651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683572480 00000100:00100000:2.0:1788846313.890347:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:2.0:1788846313.890358:0:22651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+34:18794:x1875740683572480:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788846313.891915:0:22651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+35:18794:x1875740683572480:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 1550us (1743us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788846313.891941:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:1.0:1788846313.896050:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846313.896145:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683572736 00000100:00100000:0.0:1788846313.896156:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683572736 00000100:00100000:0.0:1788846313.896216:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:0.0:1788846313.896226:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+35:18794:x1875740683572736:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788846313.896378:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+35:18794:x1875740683572736:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 152us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846313.896386:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:0.0:1788846313.907124:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846313.907743:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683572864 00000100:00100000:2.0:1788846313.907754:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683572864 00000100:00100000:2.0:1788846313.907817:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:2.0:1788846313.907827:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+35:18794:x1875740683572864:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846313.907846:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846313.907865:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b91 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c6f expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.907931:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b98 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.907946:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.908016:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846313.908185:0:22648:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846313.908205:0:22648:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.908232:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273b91 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c6f expref: 37 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.908254:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b98 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c6f expref: 36 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.908263:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846313.908279:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788846313.908283:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa000, rc 0) 00000100:00100000:2.0:1788846313.908349:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+36:18794:x1875740683572864:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 522us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.908356:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:3.0:1788846313.917014:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846313.917181:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683572992 00000100:00100000:0.0:1788846313.917191:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683572992 00000100:00100000:0.0:1788846313.917255:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1788846313.917266:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4745ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+6:2400:x1875740683572992:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846313.917298:0:24581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846313.917321:0:24581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c945f74/0x21b4d56138273b9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c76 expref: -99 pid: 24581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788846313.917346:0:24581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fa0ea, blocks: 0x0 00010000:00010000:0.0:1788846313.917366:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=697s v=(0 0) 00010000:00010000:0.0:1788846313.917370:0:24581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846313.917381:0:24581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c945f74/0x21b4d56138273b9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c76 expref: 7 pid: 24581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.917400:0:24581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c945f74/0x21b4d56138273b9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c76 expref: 7 pid: 24581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.917412:0:24581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4752f2800, rc 0) 00000100:00100000:0.0:1788846313.917489:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4745ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:2400:x1875740683572992:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 225us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846313.917496:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:1.0:1788846313.925640:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846313.926024:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683573248 00000100:00100000:2.0:1788846313.926043:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683573248 00000100:00100000:2.0:1788846313.926109:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1788846313.926118:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+36:18794:x1875740683573248:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788846313.926227:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+36:18794:x1875740683573248:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 110us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.926235:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1788846313.938195:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846313.938409:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683573376 00000100:00100000:0.0:1788846313.938419:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683573376 00000100:00100000:0.0:1788846313.938492:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:0.0:1788846313.938511:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+36:18794:x1875740683573376:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788846313.952499:0:22627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1788846313.952515:0:22627:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788846313.952599:0:22627:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1788846313.952690:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788846313.952718:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47678ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702540032:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788846313.952782:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846313.952792:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788846313.952817:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.952826:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.952833:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846313.952838:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846313.952846:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702540032 00010000:00010000:1.0:1788846313.952847:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846313.952855:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702540032 00010000:00010000:1.0:1788846313.952875:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90e3437a7500) 00010000:00010000:1.0:1788846313.952879:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846313.952884:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.952891:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab200/0x21b4d561382739ca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.952916:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846313.952920:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788846313.952928:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846313.952934:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e476789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702540032:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788846313.952940:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.952948:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aabc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846313.952958:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.952964:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.952973:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90e3437a7c00) 00010000:00010000:1.0:1788846313.952976:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846313.952979:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.952985:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d561382739d1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846313.953075:0:24155:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788846313.953078:0:24155:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788846313.953081:0:24155:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788846313.953083:0:24155:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788846314 -> 1788846314 00002000:00010000:2.0:1788846313.953085:0:24155:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788846313.953124:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e476789880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702540032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (336us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788846313.953132:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788846313.953166:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788846313.953168:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788846313.953178:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953185:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953191:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846313.953194:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953201:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788846313.953203:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e47678ad80/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788846313.953215:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47678ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702540032:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788846313.953216:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90e342aa2d00) 00010000:00010000:1.0:1788846313.953222:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846313.953233:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953240:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2200/0x21b4d56138273a87 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953259:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953265:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953271:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953276:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f2000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846313.953279:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953285:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953294:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:1.0:1788846313.953296:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846313.953299:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953304:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273b0c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953318:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953335:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953341:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953346:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46f358c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846313.953350:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953356:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953365:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:1.0:1788846313.953368:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788846313.953371:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.953376:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358c00/0x21b4d56138273b83 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.953566:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.953575:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.953590:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.953596:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f2c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846313.953599:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.953605:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.953614:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90e3437a7c00) 00010000:00010000:0.0:1788846313.953616:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788846313.953618:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.953624:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273a1e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22649 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846313.953734:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+15:18794:x1875740683573376:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 15231us (15547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846313.953742:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:3.0:1788846313.958347:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846313.958440:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683573504 00000100:00100000:0.0:1788846313.958451:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683573504 00000100:00100000:0.0:1788846313.958511:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:0.0:1788846313.958567:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:2398:x1875740683573504:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788846313.958671:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:2398:x1875740683573504:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846313.958679:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:1.0:1788846313.965062:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846313.965418:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683573760 00000100:00100000:0.0:1788846313.965428:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683573760 00000100:00100000:0.0:1788846313.965480:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:0.0:1788846313.965492:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+15:18794:x1875740683573760:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788846313.965557:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846313.965582:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa000/0x21b4d56138273b98 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c6f expref: 15 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.965601:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846313.965606:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846313.965632:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273ba6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.965646:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273ba6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.965655:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273ba6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846313.965759:0:22648:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b39dde49 reply state 00000000cfdf897d transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273ba6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.965771:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3000/0x21b4d56138273ba6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846313.965777:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846313.965779:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846313.965782:0:22648:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788846313.965863:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+16:18794:x1875740683573760:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 375us (810us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788846313.965886:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:3.0:1788846313.974920:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846313.975062:0:24155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683573888 00000100:00100000:2.0:1788846313.975073:0:24155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683573888 00000100:00100000:2.0:1788846313.975168:0:24155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1788846313.975179:0:24155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:18794:x1875740683573888:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846313.975197:0:24155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846313.975215:0:24155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c7d expref: -99 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.975272:0:24155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c945f74/0x21b4d56138273b9f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c76 expref: 8 pid: 24581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.975282:0:24155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788846313.975286:0:24155:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846313.975291:0:24155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 8 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.975325:0:24155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c945f74/0x21b4d56138273b9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c76 expref: 8 pid: 24581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.975339:0:24155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c945f74/0x21b4d56138273b9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c76 expref: 8 pid: 24581 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846313.975349:0:24155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47678b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24155:1875740702540160:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846313.975429:0:24155:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788846313.978767:0:24155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47678b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24155:1875740702540160:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846313.978933:0:24155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 8 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846313.978937:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:2.0:1788846313.978955:0:24155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaac00, rc 0) 00000100:00100000:2.0:1788846313.979016:0:24155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+8:18794:x1875740683573888:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 3838us (4103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.979025:0:24155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:1.0:1788846313.979117:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683574016 00000100:00100000:1.0:1788846313.979124:0:22632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683574016 00010000:00010000:1.0:1788846313.979158:0:22632:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c945f74/0x21b4d56138273b9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c76 expref: 8 pid: 24581 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846313.979193:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:1.0:1788846313.979203:0:22632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+8:2398:x1875740683574016:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846313.979231:0:22632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846313.979251:0:22632:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c945f74/0x21b4d56138273b9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c76 expref: 8 pid: 24581 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.979263:0:22632:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c945f74/0x21b4d56138273b9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c76 expref: 8 pid: 24581 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.979284:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c945f74/0x21b4d56138273b9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c76 expref: 8 pid: 24581 timeout: 798 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.979298:0:22632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846313.979301:0:22632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846313.979308:0:22632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 7 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.979318:0:22632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 7 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846313.979361:0:22632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 7 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846313.979375:0:22632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22632:1875740702540288:192.168.203.20@tcp:105: 00000100:00100000:1.0:1788846313.979424:0:22632:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788846313.982961:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846313.983042:0:24581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683574144 00000100:00100000:0.0:1788846313.983049:0:24581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683574144 00000100:00100000:2.0:1788846313.983061:0:22632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22632:1875740702540288:192.168.203.20@tcp:105: 00010000:00010000:2.0:1788846313.983089:0:22632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846313.983112:0:24581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:0.0:1788846313.983126:0:24581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+8:2401:x1875740683574144:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788846313.983143:0:22632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+8:2398:x1875740683574016:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 3940us (4204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.983153:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00002000:00010000:0.0:1788846313.983276:0:24581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788846313.983280:0:24581:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788846313 00002000:00010000:0.0:1788846313.983283:0:24581:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788846312 00002000:00010000:0.0:1788846313.983285:0:24581:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788846314 -> 1788846313 00002000:00010000:0.0:1788846313.983288:0:24581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788846313.983327:0:24581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+8:2401:x1875740683574144:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 203us (375us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788846313.983334:0:24581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:1.0:1788846313.986427:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846313.986669:0:24156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683574272 00000100:00100000:3.0:1788846313.986679:0:24156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683574272 00000100:00100000:3.0:1788846313.986734:0:24156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:3.0:1788846313.986754:0:24156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+8:2401:x1875740683574272:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788846313.986794:0:24156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.986815:0:24156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 8 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.986824:0:24156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846313.986829:0:24156:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788846313.986834:0:24156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.986879:0:24156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 8 pid: 24155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.986893:0:24156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 8 pid: 24155 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846313.986908:0:24156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24156:1875740702540416:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846313.987173:0:24156:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b5fd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788846313.992084:0:24156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24156:1875740702540416:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846313.992115:0:24156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846313.993023:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846313.993430:0:23802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683574400 00000100:00100000:0.0:1788846313.993440:0:23802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683574400 00010000:00010000:0.0:1788846313.993488:0:23802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 9 pid: 24155 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846313.993632:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1788846313.993644:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+9:2398:x1875740683574400:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846313.993658:0:22633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846313.993677:0:22633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 9 pid: 24155 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.993690:0:22633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 9 pid: 24155 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.993713:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad6ad7f9/0x21b4d56138273bad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c7d expref: 9 pid: 24155 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.993732:0:22633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788846313.993736:0:22633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788846313.993742:0:22633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.993774:0:22633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846313.993804:0:22633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846313.993868:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+8:2398:x1875740683574400:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 225us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846313.993875:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00010000:00010000:2.0:1788846313.994466:0:24156:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.994479:0:24156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.994501:0:24156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.994548:0:24156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.994559:0:24156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.994567:0:24156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846313.994571:0:24156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.994580:0:24156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.994593:0:24156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846313.994600:0:24156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e951ed02/0x21b4d56138273bb4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846313.994671:0:24156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:2401:x1875740683574272:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 7928us (8252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846313.994679:0:24156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1788846313.999990:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846314.000140:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683574656 00000100:00100000:0.0:1788846314.000151:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683574656 00000100:00100000:0.0:1788846314.000212:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:0.0:1788846314.000222:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+16:18794:x1875740683574656:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788846314.000301:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.000320:0:22647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d56138273b05 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c3e expref: 16 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.000340:0:22647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846314.001682:0:22647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d56138273b05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c3e expref: 16 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846314.001705:0:22647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d56138273b05 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c3e expref: 16 pid: 22647 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846314.001722:0:22647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22647:1875740702540544:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846314.002224:0:22647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685180 going to sleep for 11 seconds 00000100:00100000:0.0:1788846314.005304:0:22647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22647:1875740702540544:192.168.203.20@tcp:104: 00010000:00010000:0.0:1788846314.005336:0:22647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846314.006673:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846314.007266:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683574784 00000100:00100000:2.0:1788846314.007276:0:22634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683574784 00010000:00010000:2.0:1788846314.007329:0:22634:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d56138273b05 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c3e expref: 17 pid: 22647 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846314.007385:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1788846314.007396:0:22634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+17:2398:x1875740683574784:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846314.007410:0:22634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846314.007418:0:22634:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d56138273b05 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c3e expref: 17 pid: 22647 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.007430:0:22634:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d56138273b05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c3e expref: 17 pid: 22647 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.007464:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f358200/0x21b4d56138273b05 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c3e expref: 17 pid: 22647 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.007481:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:2.0:1788846314.007486:0:22634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359000/0x21b4d56138273b21 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c4c expref: 16 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.007497:0:22634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.007505:0:22634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.007513:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.007582:0:22634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846314.007635:0:22634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+16:2398:x1875740683574784:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 241us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846314.007649:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00010000:00010000:0.0:1788846314.007788:0:22647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.007796:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.008037:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.008051:0:22647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b8a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c68 expref: 16 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.008058:0:22647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.008087:0:22647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b8a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c68 expref: 16 pid: 22649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.008099:0:22647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b8a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c68 expref: 16 pid: 22649 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846314.008111:0:22647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22647:1875740702540672:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846314.008170:0:22647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1788846314.008225:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846314.013120:0:22647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22647:1875740702540672:192.168.203.20@tcp:104: 00010000:00010000:0.0:1788846314.013152:0:22647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846314.013244:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846314.013490:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683574912 00000100:00100000:3.0:1788846314.013497:0:22633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683574912 00010000:00010000:3.0:1788846314.013642:0:22633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b8a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c68 expref: 17 pid: 22649 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846314.013680:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1788846314.013690:0:22633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+17:2398:x1875740683574912:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846314.013705:0:22633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846314.013712:0:22633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b8a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c68 expref: 17 pid: 22649 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.013723:0:22633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b8a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c68 expref: 17 pid: 22649 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.013967:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273b8a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c68 expref: 17 pid: 22649 timeout: 798 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.013988:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:3.0:1788846314.014078:0:22633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.014088:0:22633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.014096:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.014126:0:22633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846314.014180:0:22633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+16:2398:x1875740683574912:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 492us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846314.014188:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00010000:00010000:0.0:1788846314.014247:0:22647:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.014254:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788846314.014353:0:22647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1788846314.014480:0:22647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1788846314.014515:0:22647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1788846314.016397:0:22647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22647:1875740702540800:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788846314.016476:0:22647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846314.016512:0:22647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b6853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846314.017148:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702540800 00000100:00100000:1.0:1788846314.017156:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702540800 00000100:00100000:1.0:1788846314.017206:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788846314.017216:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22647:x1875740702540800:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788846314.017322:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22647:x1875740702540800:12345-0@lo:1000:mdt00_000.0 Request processed in 107us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846314.017330:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788846314.017599:0:22647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22647:1875740702540800:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788846314.017803:0:22647:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788846314.017866:0:22647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22647:1875740702540928:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788846314.017901:0:22647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846314.017918:0:22647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685900 going to sleep for 11 seconds 00000100:00100000:1.0:1788846314.018120:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702540928 00000100:00100000:1.0:1788846314.018125:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702540928 00000100:00100000:1.0:1788846314.018161:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788846314.018168:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22647:x1875740702540928:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788846314.018290:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22647:x1875740702540928:12345-0@lo:1000:mdt00_000.0 Request processed in 123us (387us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788846314.018297:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788846314.018693:0:22647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22647:1875740702540928:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788846314.018737:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018758:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018780:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018786:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f2800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846314.018790:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018798:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018813:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846314.018816:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788846314.018820:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018826:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2800/0x21b4d56138273bc2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018856:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018863:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018868:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018874:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f3600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846314.018876:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018890:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018899:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:0.0:1788846314.018901:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788846314.018908:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359000/0x21b4d56138273b21 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c4c expref: 19 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018919:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359000/0x21b4d56138273b21 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c4c expref: 19 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018927:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359000/0x21b4d56138273b21 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c4c expref: 19 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.018977:0:22647:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e46f359000/0x21b4d56138273b21 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c4c expref: 19 pid: 22647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846314.018990:0:22647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22647:1875740702541056:192.168.203.20@tcp:105: 00000100:00100000:0.0:1788846314.019067:0:22647:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846314.022826:0:22647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22647:1875740702541056:192.168.203.20@tcp:105: 00010000:00010000:0.0:1788846314.022854:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.022864:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f3600/0x21b4d56138273b1a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.022893:0:22647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273bc9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.022919:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273bc9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.022930:0:22647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273bc9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.022941:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273bc9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.022947:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273bc9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.022953:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273bc9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.022959:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f2000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846314.022963:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273bc9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.022970:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273bc9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.022980:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:0.0:1788846314.022983:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846314.022986:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273bc9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.022991:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2000/0x21b4d56138273bc9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.023010:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.023022:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.023037:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.023042:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4752f2c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846314.023045:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.023050:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.023058:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:0.0:1788846314.023060:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788846314.023063:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846314.023069:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e4752f2c00/0x21b4d56138273bbb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22647 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846314.023229:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+19:18794:x1875740683574656:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 23007us (23248us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1788846314.023239:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000020:00080000:0.0:1788846314.023245:0:22647:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788846314.023383:0:22683:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788846314.023388:0:22683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846314.023407:0:22683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788846314.023412:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788846314.026166:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846314.026269:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683575168 00000100:00100000:2.0:1788846314.026278:0:22650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683575168 00000100:00100000:2.0:1788846314.026332:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:2.0:1788846314.026343:0:22650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+19:18794:x1875740683575168:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788846314.026660:0:22650:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788846314.026693:0:22650:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1788846314.026727:0:22650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa400/0x21b4d56138273bd0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.026755:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa400/0x21b4d56138273bd0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.026766:0:22650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa400/0x21b4d56138273bd0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.026774:0:22650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa400/0x21b4d56138273bd0 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.026780:0:22650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa400/0x21b4d56138273bd0 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.026786:0:22650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa400/0x21b4d56138273bd0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.026799:0:22650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788846314.026884:0:22650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+21:18794:x1875740683575168:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 543us (726us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1788846314.026892:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000020:00080000:2.0:1788846314.026896:0:22650:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788846314.027152:0:23801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846314.027160:0:23801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa400/0x21b4d56138273bd0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846314.027168:0:23801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846314.027172:0:23801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa400/0x21b4d56138273bd0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846314.027180:0:23801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa400/0x21b4d56138273bd0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846314.027216:0:23801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:1.0:1788846314.027219:0:23801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788846314.027223:0:23801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa400/0x21b4d56138273bd0 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846314.027229:0:23801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa400/0x21b4d56138273bd0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22650 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846314.027243:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846314.027245:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846314.027246:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846314.033221:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846314.033305:0:25444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683575296 00000100:00100000:3.0:1788846314.033315:0:25444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683575296 00000100:00100000:3.0:1788846314.033369:0:25444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1788846314.033378:0:25444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+21:18793:x1875740683575296:12345-192.168.203.20@tcp:49:dd.0 00000100:00100000:3.0:1788846314.033563:0:25444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+21:18793:x1875740683575296:12345-192.168.203.20@tcp:49:dd.0 Request processed in 185us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846314.033571:0:25444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:0.0:1788846314.038123:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846314.038229:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683575424 00000100:00100000:2.0:1788846314.038238:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683575424 00000100:00100000:2.0:1788846314.038288:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:2.0:1788846314.038298:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+21:18793:x1875740683575424:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:2.0:1788846314.038317:0:22648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846314.038336:0:22648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabe00/0x21b4d56138273bd7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754c84 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.038371:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d56138273bde lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.038385:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d56138273bde lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.038395:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d56138273bde lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22648 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.038675:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabe00/0x21b4d56138273bd7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c84 expref: 23 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.038696:0:22648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d56138273bde lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754c84 expref: 22 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.038705:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90e342aa2800) 00010000:00010000:2.0:1788846314.038708:0:22648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788846314.038719:0:22648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa800, rc 0) 00000100:00100000:2.0:1788846314.038784:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+22:18793:x1875740683575424:12345-192.168.203.20@tcp:101:dd.0 Request processed in 486us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846314.038791:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:1.0:1788846314.226130:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846314.226332:0:24159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683575552 00000100:00100000:3.0:1788846314.226342:0:24159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683575552 00000100:00100000:3.0:1788846314.226416:0:24159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1788846314.226427:0:24159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:2401:x1875740683575552:12345-192.168.203.20@tcp:4:dd.0 00002000:00010000:3.0:1788846314.226473:0:24159:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a9fa0e9, atime: 0x6a9fa0e8, ctime: 0x6a9fa0e9, blocks: 0x0 00010000:00010000:3.0:1788846314.226483:0:24159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138273be5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.226518:0:24159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=698s v=(0 0) 00010000:00010000:3.0:1788846314.226556:0:24159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846314.226563:0:24159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138273be5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.226577:0:24159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138273be5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846314.232209:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846314.232342:0:24161:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788846314.232352:0:24161:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788846314.232633:0:24161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683575680 00000100:00100000:1.0:1788846314.232644:0:24161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683575680 00000100:00100000:2.0:1788846314.233724:0:25695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:2.0:1788846314.233738:0:25695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e476788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+9:2400:x1875740683575680:12345-192.168.203.20@tcp:4:dd.0 00010000:00010000:2.0:1788846314.233774:0:25695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045967aac/0x21b4d56138273bec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.233790:0:25695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846314.233795:0:25695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846314.233801:0:25695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045967aac/0x21b4d56138273bec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.233815:0:25695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045967aac/0x21b4d56138273bec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846314.301668:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846314.302082:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702541184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788846314.302177:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846314.302610:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702541184 00000100:00100000:0.0:1788846314.302621:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702541184 00000100:00100000:2.0:1788846314.304020:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788846314.304045:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47678b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702541184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788846314.304077:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 34029248 pending 7704576 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788846314.304182:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47678b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702541184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846314.304191:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788846314.304296:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702541184:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788846314.304946:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788846314.328945:0:24150:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1788846314.328975:0:24150:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:3.0:1788846314.329189:0:24159:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1788846314.329195:0:24159:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788846313 -> 1788846314 00002000:00010000:3.0:1788846314.329198:0:24159:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788846313 -> 1788846314 00002000:00010000:3.0:1788846314.329200:0:24159:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:3.0:1788846314.329216:0:24159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138273be5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.329228:0:24159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138273be5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.329237:0:24159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138273be5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.329244:0:24159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846314.329249:0:24159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138273be5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.329258:0:24159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138273be5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.329285:0:24159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138273be5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846314.329293:0:24159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138273be5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846314.329400:0:24159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+7:2401:x1875740683575552:12345-192.168.203.20@tcp:4:dd.0 Request processed in 102971us (103276us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788846314.329410:0:24159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00010000:00010000:1.0:1788846314.363985:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788846314.366316:0:24150:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1788846314.366485:0:25695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788846314.366490:0:25695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788846314.366508:0:25695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045967aac/0x21b4d56138273bec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.366565:0:25695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045967aac/0x21b4d56138273bec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.366575:0:25695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045967aac/0x21b4d56138273bec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.366583:0:25695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aabe00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846314.366588:0:25695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045967aac/0x21b4d56138273bec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.366597:0:25695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045967aac/0x21b4d56138273bec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.366616:0:25695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045967aac/0x21b4d56138273bec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846314.366623:0:25695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045967aac/0x21b4d56138273bec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846314.366734:0:25695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e476788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4fd9adc-3143-4fc2-bf19-f0918d5552ac+5:2400:x1875740683575680:12345-192.168.203.20@tcp:4:dd.0 Request processed in 132995us (134532us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788846314.366768:0:25695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:0.0:1788846314.810857:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788846314.810886:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702541312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846314.810962:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846314.811238:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846314.811269:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702541440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846314.811426:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846314.811703:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702541312 00000100:00100000:1.0:1788846314.811716:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702541312 00000100:00100000:1.0:1788846314.812253:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702541440 00000100:00100000:1.0:1788846314.812260:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702541440 00000100:00100000:1.0:1788846314.812413:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788846314.812425:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702541312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846314.812475:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846314.812694:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702541312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 270us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846314.812703:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788846314.812724:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788846314.812731:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702541440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788846314.812751:0:22652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1788846314.812938:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702541440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 207us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846314.812946:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788846314.814476:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702541440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846314.816365:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f35ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702541312:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788846315.392485:0:22636:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846316.348838:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788846316.348863:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702541568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788846316.348933:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846316.349091:0:24158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702541568 00000100:00100000:1.0:1788846316.349111:0:24158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702541568 00000100:00100000:1.0:1788846316.349178:0:24158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788846316.349189:0:24158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702541568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788846316.349218:0:24158:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1788846316.349267:0:24158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702541568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846316.349275:0:24158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788846316.349315:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1788846316.349320:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e47678ad80, transno 12884901892 00000004:00080000:1.0:1788846316.349337:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1788846316.349366:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702541568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788846316.352193:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788846316.419564:0:23801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788846316.483995:0:25732:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:2.0:1788846317.113861:0:22683:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788846317.113871:0:22683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846317.113911:0:22683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788846317.113920:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788846317.433775:0:22635:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846317.881883:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788846317.881915:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702541696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846317.882013:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846317.882087:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702541696 00000100:00100000:0.0:1788846317.882096:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702541696 00000100:00100000:0.0:1788846317.882163:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788846317.882174:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702541696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788846317.882213:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788846317.882264:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702541696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846317.882271:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788846317.882296:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788846317.882339:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702541696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846317.885308:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702541824:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.885402:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.885452:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341ba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702542336:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.885481:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.885502:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702542848:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.885552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.885577:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788846317.885583:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702541952:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.885605:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.885622:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341ba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702542464:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.885646:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.885662:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702542976:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.885682:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.885714:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702541824 00000100:00100000:1.0:1788846317.885723:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702541824 00000100:00100000:1.0:1788846317.885777:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788846317.885787:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3642:x1875740702541824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.885845:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa+24:3642:x1875740702541824:12345-0@lo:400:kworker.0 Request processed in 59us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.885853:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788846317.885892:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702542336 00000100:00100000:1.0:1788846317.885896:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702542336 00000100:00100000:1.0:1788846317.885916:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702541952 00000100:00100000:1.0:1788846317.885919:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702541952 00000100:00100000:1.0:1788846317.885933:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788846317.885940:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702542336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.885991:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702542336:12345-0@lo:400:kworker.0 Request processed in 52us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.885998:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788846317.886023:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788846317.886030:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702541952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886073:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702541952:12345-0@lo:400:kworker.0 Request processed in 44us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.886080:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788846317.886105:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702542208:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886131:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.886151:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702542720:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886174:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.886185:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702543232:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886203:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.886217:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788846317.886222:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702542080:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886264:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.886285:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702542592:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886309:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.886325:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702543104:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886345:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846317.886368:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702542848 00000100:00100000:1.0:1788846317.886372:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702542848 00000100:00100000:1.0:1788846317.886405:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702542976 00000100:00100000:1.0:1788846317.886408:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702542976 00000100:00100000:1.0:1788846317.886429:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702542208 00000100:00100000:1.0:1788846317.886432:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702542208 00000100:00100000:1.0:1788846317.886443:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702542720 00000100:00100000:1.0:1788846317.886445:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702542720 00000100:00100000:1.0:1788846317.886457:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702543232 00000100:00100000:1.0:1788846317.886460:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702543232 00000100:00100000:1.0:1788846317.886472:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702543104 00000100:00100000:1.0:1788846317.886475:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702543104 00000100:00100000:1.0:1788846317.886489:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788846317.886495:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702542848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886557:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702542848:12345-0@lo:400:kworker.0 Request processed in 62us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.886564:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788846317.886577:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788846317.886583:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702542976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886611:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702542976:12345-0@lo:400:kworker.0 Request processed in 29us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.886617:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788846317.886629:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788846317.886635:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702542208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886667:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702542208:12345-0@lo:400:kworker.0 Request processed in 32us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.886673:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788846317.886685:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788846317.886691:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702542720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886718:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702542720:12345-0@lo:400:kworker.0 Request processed in 28us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.886734:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788846317.886746:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788846317.886752:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702543232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886779:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702543232:12345-0@lo:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.886785:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788846317.886796:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788846317.886802:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702543104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886827:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702543104:12345-0@lo:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.886832:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788846317.886852:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702542464 00000100:00100000:1.0:1788846317.886856:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702542464 00000100:00100000:1.0:1788846317.886887:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702542080 00000100:00100000:1.0:1788846317.886891:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702542080 00000100:00100000:1.0:1788846317.886902:0:24154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702542592 00000100:00100000:1.0:1788846317.886904:0:24154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702542592 00000100:00100000:1.0:1788846317.886919:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788846317.886925:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702542464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.886957:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702542464:12345-0@lo:400:kworker.0 Request processed in 32us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.886964:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788846317.886975:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788846317.886981:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702542080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.887021:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702542080:12345-0@lo:400:kworker.0 Request processed in 41us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.887037:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788846317.887049:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788846317.887055:0:24154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702542592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.887083:0:24154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341b77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702542592:12345-0@lo:400:kworker.0 Request processed in 29us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846317.887089:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788846317.887143:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702542080:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.887154:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341ba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702542592:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.887161:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341ba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702543104:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.887171:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702542208:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.887181:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341ba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702542720:0@lo:400:kworker.0 00010000:00080000:1.0:1788846317.887193:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341ba7b80 x1875740702543232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846317.887203:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702543232:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.887250:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702541952:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.887263:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341ba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702542464:0@lo:400:kworker.0 00010000:00080000:1.0:1788846317.887274:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341ba6680 x1875740702542976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846317.887282:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341ba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702542976:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.887294:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b7fa21c-2daf-435e-ba4d-f8ccd5f6ebfa:3642:1875740702541824:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.887313:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341ba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702542336:0@lo:400:kworker.0 00000100:00100000:1.0:1788846317.887323:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341ba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702542848:0@lo:400:kworker.0 00000100:00100000:0.0:1788846317.890955:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788846317.890988:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702543360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788846317.891097:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788846317.891209:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788846317.891216:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788846317.891220:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788846317.891223:0:22643:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846317.891252:0:24157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702543360 00000100:00100000:0.0:1788846317.891262:0:24157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702543360 00000100:00100000:0.0:1788846317.891321:0:24157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788846317.891330:0:24157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702543360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788846317.891358:0:24157:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788846317.891411:0:24157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702543360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846317.891419:0:24157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788846317.891479:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702543360:0@lo:13:osp-pre-1-1.0 Debug log: 14026 lines, 14026 kept, 0 dropped, 0 bad.