00010000:00010000:3.0F:1788587323.179108:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1788587324.203591:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1788587324.563615:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587324.563673:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587324.563700:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587324.563774:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587324.563827:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587324.563851:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587324.563872:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587324.563894:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587324.563918:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587324.563945:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292151040 00000100:00100000:2.0:1788587324.563955:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292151040 00000100:00100000:2.0:1788587324.564006:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292151552 00000100:00100000:2.0:1788587324.564010:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292151552 00000100:00100000:2.0:1788587324.564023:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292150912 00000100:00100000:2.0:1788587324.564026:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292150912 00000100:00100000:2.0:1788587324.564038:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292151424 00000100:00100000:2.0:1788587324.564040:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292151424 00000100:00100000:2.0:1788587324.564057:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:2.0:1788587324.564079:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2411:x1875469292151040:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587324.564147:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2411:x1875469292151040:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 69us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587324.564155:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:2.0:1788587324.564173:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:2.0:1788587324.564192:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2411:x1875469292151552:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587324.564219:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2411:x1875469292151552:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587324.564225:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:2.0:1788587324.564239:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:2.0:1788587324.564246:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+21:2411:x1875469292150912:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587324.564286:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+21:2411:x1875469292150912:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 41us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587324.564293:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:2.0:1788587324.564306:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:2.0:1788587324.564312:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2411:x1875469292151424:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587324.564337:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2411:x1875469292151424:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587324.564578:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:2.0:1788587324.564600:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292151296 00000100:00100000:2.0:1788587324.564605:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292151296 00000100:00100000:2.0:1788587324.564631:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292151808 00000100:00100000:2.0:1788587324.564633:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292151808 00000100:00100000:2.0:1788587324.564644:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292151168 00000100:00100000:2.0:1788587324.564646:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292151168 00000100:00100000:2.0:1788587324.564654:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292151680 00000100:00100000:2.0:1788587324.564656:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292151680 00000100:00100000:2.0:1788587324.564667:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:2.0:1788587324.564673:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2411:x1875469292151296:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587324.564699:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2411:x1875469292151296:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 26us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587324.564704:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:2.0:1788587324.564714:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:3.0:1788587324.564845:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292150784 00000100:00100000:3.0:1788587324.564850:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292150784 00000100:00100000:2.0:1788587324.564869:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2411:x1875469292151808:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587324.564886:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 164 00000100:00100000:3.0:1788587324.564896:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2411:x1875469292150784:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587324.564903:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2411:x1875469292151808:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587324.564921:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:3.0:1788587324.564932:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2411:x1875469292150784:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 37us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587324.564939:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:3.0:1788587324.564944:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 164 00000100:00100000:2.0:1788587324.564951:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2411:x1875469292151168:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587324.564981:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2411:x1875469292151168:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 34us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587324.564986:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:2.0:1788587324.564997:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:2.0:1788587324.565003:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2411:x1875469292151680:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587324.565023:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2411:x1875469292151680:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 19us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587324.565028:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00080000:2.0:1788587324.565855:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587324.565862:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587324.565864:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587324.565867:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587324.974524:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587324.974553:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310047360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587324.974628:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587324.974767:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310047360 00000100:00100000:2.0:1788587324.974777:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310047360 00000100:00100000:2.0:1788587324.974844:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587324.974852:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310047360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587324.974886:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62849024 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788587324.974929:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310047360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587324.974951:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788587324.975344:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587324.975383:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310047360:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788587325.068995:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000020:00080000:1.0:1788587325.069010:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbf087ff9c0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1788587325.069015:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf10839d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf087ff180 00000020:00080000:1.0:1788587325.069019:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbf10839900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbf3b3adc00 00010000:00010000:2.0:1788587325.069026:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587325.069039:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587325.069047:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587325.069054:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c18200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587325.069059:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587325.069068:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587325.069070:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00010000:00010000:2.0:1788587325.069092:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:2.0:1788587325.069096:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587325.069101:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587325.069108:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18200/0x419e1ae1f63450e9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788587325.069156:0:16483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1788587325.069407:0:16483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1788587325.103034:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587325.103070:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292151936 00000100:00100000:2.0:1788587325.103079:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292151936 00000100:00100000:2.0:1788587325.103142:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:2.0:1788587325.103151:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+12:15727:x1875469292151936:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788587325.103246:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+12:15727:x1875469292151936:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 Request processed in 95us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587325.103253:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 63 00000100:00100000:1.0:1788587325.108576:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587325.108611:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292152064 00000100:00100000:1.0:1788587325.108620:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292152064 00000100:00100000:1.0:1788587325.108664:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:1.0:1788587325.108685:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:15727:x1875469292152064:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788587325.108772:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:15727:x1875469292152064:12345-192.168.203.14@tcp:60:lhsmtool_posix.0 Request processed in 89us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587325.108780:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 64 00000100:00100000:2.0:1788587325.112310:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587325.112469:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292152320 00000100:00100000:3.0:1788587325.112479:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292152320 00000100:00100000:3.0:1788587325.112566:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:3.0:1788587325.112577:0:16445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+12:15727:x1875469292152320:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788587325.113019:0:16445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+13:15727:x1875469292152320:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 441us (715us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788587325.113027:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00010000:00010000:3.0:1788587325.227013:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587325.998323:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310047616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587325.998390:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587325.998467:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310047616 00000100:00100000:3.0:1788587325.998475:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310047616 00000100:00100000:3.0:1788587325.998533:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587325.998544:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310047616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587325.998568:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62849024 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788587325.998610:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310047616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587325.998631:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788587325.998650:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587325.998683:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310047616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587325.998872:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf40c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310047744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587325.998899:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1788587325.999027:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310047488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587325.999064:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587325.999226:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310047744 00000100:00100000:2.0:1788587325.999231:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310047744 00000100:00100000:2.0:1788587325.999255:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310047488 00000100:00100000:2.0:1788587325.999258:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310047488 00000100:00100000:2.0:1788587325.999271:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587325.999277:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe06894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310047744:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788587325.999283:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788587325.999349:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587325.999383:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe06894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310047744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587325.999389:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587325.999402:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587325.999407:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310047488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587325.999415:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587325.999441:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310047488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587325.999446:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587325.999577:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf40c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310047744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587325.999611:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310047488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587325.999619:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587325.999624:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310047872:0@lo:400:kworker.0 00000100:00100000:3.0:1788587325.999650:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587325.999727:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310047872 00000100:00100000:1.0:1788587325.999732:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310047872 00000100:00100000:1.0:1788587325.999761:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788587325.999769:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3473:x1875469310047872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587325.999928:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3473:x1875469310047872:12345-0@lo:400:kworker.0 Request processed in 159us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587325.999934:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788587325.999999:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310047872:0@lo:400:kworker.0 00000100:00100000:3.0:1788587326.000189:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310048000:0@lo:400:kworker.0 00000100:00100000:3.0:1788587326.000217:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587326.000325:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310048000 00000100:00100000:1.0:1788587326.000329:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310048000 00000100:00100000:1.0:1788587326.000359:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788587326.000365:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310048000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587326.000479:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310048384:0@lo:400:kworker.0 00000100:00100000:0.0:1788587326.000505:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587326.000517:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469310048896:0@lo:400:kworker.0 00000100:00100000:0.0:1788587326.000537:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587326.000553:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788587326.000558:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310048512:0@lo:400:kworker.0 00000100:00100000:0.0:1788587326.000578:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587326.000592:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310049024:0@lo:400:kworker.0 00000100:00100000:0.0:1788587326.000610:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587326.000626:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310048896 00000100:00100000:2.0:1788587326.000630:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310048896 00000100:00100000:0.0:1788587326.000630:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310048512 00000100:00100000:0.0:1788587326.000633:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310048512 00000100:00100000:0.0:1788587326.000662:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310049024 00000100:00100000:0.0:1788587326.000665:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310049024 00000100:00100000:1.0:1788587326.000714:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310048000:12345-0@lo:400:kworker.0 Request processed in 348us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587326.000732:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788587326.000744:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310048384 00000100:00100000:1.0:1788587326.000747:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310048384 00000100:00100000:1.0:1788587326.000761:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788587326.000766:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310048384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587326.000818:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310048384:12345-0@lo:400:kworker.0 Request processed in 51us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587326.000824:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788587326.000854:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788587326.000862:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310048512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587326.000902:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310048512:12345-0@lo:400:kworker.0 Request processed in 41us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587326.000941:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310048000:0@lo:400:kworker.0 00000100:00100000:3.0:1788587326.000962:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf0363a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310048128:0@lo:400:kworker.0 00000100:00100000:3.0:1788587326.000987:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587326.001005:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310048640:0@lo:400:kworker.0 00000100:00100000:3.0:1788587326.001022:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587326.001033:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788587326.001037:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310048256:0@lo:400:kworker.0 00000100:00100000:3.0:1788587326.001055:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587326.001075:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf03639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310048768:0@lo:400:kworker.0 00000100:00100000:3.0:1788587326.001096:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788587326.001115:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587326.001119:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587326.001209:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310048128 00000100:00100000:3.0:1788587326.001212:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310048128 00000100:00100000:3.0:1788587326.001243:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587326.001251:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310048128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587326.001284:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310048128:12345-0@lo:400:kworker.0 Request processed in 34us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587326.001289:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788587326.001302:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587326.001317:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310048128:0@lo:400:kworker.0 00000100:00100000:3.0:1788587326.001348:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310048640 00000100:00100000:3.0:1788587326.001351:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310048640 00000100:00100000:1.0:1788587326.001385:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587326.001394:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469310048896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587326.001425:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469310048896:12345-0@lo:400:kworker.0 Request processed in 33us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587326.001430:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587326.001441:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310048256 00000100:00100000:1.0:1788587326.001443:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310048256 00000100:00100000:1.0:1788587326.001454:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310048768 00000100:00100000:1.0:1788587326.001456:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310048768 00000100:00100000:1.0:1788587326.001468:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587326.001473:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310049024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587326.001501:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310049024:12345-0@lo:400:kworker.0 Request processed in 27us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587326.001507:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587326.001518:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788587326.001523:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310048256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587326.001553:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310048256:12345-0@lo:400:kworker.0 Request processed in 30us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587326.001569:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788587326.001580:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587326.001585:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310048768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587326.001614:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310048768:12345-0@lo:400:kworker.0 Request processed in 29us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587326.001620:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587326.001644:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310048256:0@lo:400:kworker.0 00010000:00080000:1.0:1788587326.001654:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf03639c00 x1875469310048768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587326.001663:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310048768:0@lo:400:kworker.0 00000100:00100000:1.0:1788587326.001696:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf0363bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310048512:0@lo:400:kworker.0 00010000:00080000:1.0:1788587326.001705:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2d180 x1875469310049024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587326.001712:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310049024:0@lo:400:kworker.0 00000100:00100000:1.0:1788587326.001722:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310048384:0@lo:400:kworker.0 00000100:00100000:1.0:1788587326.001731:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469310048896:0@lo:400:kworker.0 00000100:00100000:2.0:1788587326.002908:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788587326.002988:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788587326.003000:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469310048640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587326.003071:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469310048640:12345-0@lo:400:kworker.0 Request processed in 75us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587326.003078:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788587326.003153:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf03638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310048640:0@lo:400:kworker.0 00000100:00080000:2.0:1788587326.003243:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587326.003248:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788587326.251223:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587326.506947:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310049152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587326.507024:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587326.507109:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310049280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587326.510605:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587326.517921:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310049152 00000100:00100000:1.0:1788587326.517936:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310049152 00000100:00100000:1.0:1788587326.517980:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310049280 00000100:00100000:1.0:1788587326.517983:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310049280 00000100:00100000:1.0:1788587326.518004:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587326.518013:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310049152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587326.518069:0:16447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788587326.518149:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310049152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (11125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587326.518157:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587326.518188:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587326.518195:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310049280:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587326.518215:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310049152:0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587326.518216:0:16447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587326.518313:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310049280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (7715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587326.518320:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788587326.518490:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310049280:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788587326.891223:0:16478:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788587326.891232:0:16478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587326.891270:0:16478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788587326.891276:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788587327.274926:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587327.403715:0:17096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788587328.299579:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587329.325491:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587329.693610:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587329.693660:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587329.693688:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587329.693714:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587329.693733:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587329.693747:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587329.693761:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587329.693777:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587329.693827:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587329.693864:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292152704 00000100:00100000:3.0:1788587329.693873:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292152704 00000100:00100000:3.0:1788587329.693923:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292152576 00000100:00100000:3.0:1788587329.693933:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292152576 00000100:00100000:3.0:1788587329.693971:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292153216 00000100:00100000:3.0:1788587329.693974:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292153216 00000100:00100000:3.0:1788587329.693994:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292153088 00000100:00100000:3.0:1788587329.693997:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292153088 00000100:00100000:3.0:1788587329.694021:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:3.0:1788587329.694032:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292152704:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587329.694101:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292152704:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 71us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587329.694110:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:3.0:1788587329.694129:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:3.0:1788587329.694136:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+13:2412:x1875469292152576:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587329.694175:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+13:2412:x1875469292152576:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 40us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587329.694181:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:3.0:1788587329.694192:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:3.0:1788587329.694197:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2411:x1875469292153216:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587329.694216:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2411:x1875469292153216:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 19us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587329.694222:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 69 00000100:00100000:3.0:1788587329.694231:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:3.0:1788587329.694237:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2411:x1875469292153088:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587329.694256:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2411:x1875469292153088:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 19us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587329.694262:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 70 00000100:00100000:3.0:1788587329.694286:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292152832 00000100:00100000:3.0:1788587329.694289:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292152832 00000100:00100000:3.0:1788587329.694310:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292152960 00000100:00100000:3.0:1788587329.694313:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292152960 00000100:00100000:3.0:1788587329.694322:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292153344 00000100:00100000:3.0:1788587329.694324:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292153344 00000100:00100000:3.0:1788587329.694334:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292153472 00000100:00100000:3.0:1788587329.694336:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292153472 00000100:00100000:3.0:1788587329.694361:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:3.0:1788587329.694368:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292152832:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587329.694393:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292152832:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 26us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587329.694399:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:3.0:1788587329.694410:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:3.0:1788587329.694416:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2408:x1875469292152960:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:3.0:1788587329.694433:0:17750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344e2d 00000100:00080000:3.0:1788587329.694446:0:17750:0:(import.c:65:import_set_state_nolock()) ffff8cbe044fc000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587329.694486:0:17750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788587329.694694:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+2:2408:x1875469292152960:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 276us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587329.694701:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:3.0:1788587329.694715:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:3.0:1788587329.694723:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03638e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2408:x1875469292153344:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:3.0:1788587329.694735:0:17750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344e65 00000100:00080000:3.0:1788587329.694742:0:17750:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587329.694764:0:17750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934606 00010000:00010000:1.0:1788587329.694857:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587329.694877:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:1.0:1788587329.694889:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0363a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2408:x1875469292153472:12345-192.168.203.14@tcp:9:kworker.0 00000020:00000080:1.0:1788587329.694911:0:17877:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344e6c 00000100:00080000:1.0:1788587329.694919:0:17877:0:(import.c:65:import_set_state_nolock()) ffff8cbf3c2b3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788587329.694959:0:17877:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788587329.694970:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03638e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a3fdddd-8216-4b58-9628-ff883535a8b8+2:2408:x1875469292153344:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 232us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587329.694985:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:1.0:1788587329.695211:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0363a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+2:2408:x1875469292153472:12345-192.168.203.14@tcp:9:kworker.0 Request processed in 325us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587329.695312:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292152448 00000100:00100000:2.0:1788587329.695324:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292152448 00000100:00100000:2.0:1788587329.695357:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 166 00000100:00100000:2.0:1788587329.695365:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2412:x1875469292152448:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587329.695389:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2412:x1875469292152448:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 26us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587329.695395:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 166 00000100:00080000:2.0:1788587329.695436:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587329.695440:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587329.695443:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587329.695445:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587329.695458:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 29 00010000:00010000:1.0:1788587329.695506:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587329.695982:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587330.092067:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587330.092089:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310049408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587330.092162:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587330.092227:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310049408 00000100:00100000:3.0:1788587330.092235:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310049408 00000100:00100000:3.0:1788587330.092287:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587330.092296:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310049408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587330.092329:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59441152 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788587330.092375:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310049408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587330.092382:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587330.092457:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310049408:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788587330.094243:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788587330.148483:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788587330.148500:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1788587330.148533:0:16483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1788587330.148546:0:16483:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:00100000:0.0:1788587330.165133:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a3fdddd-8216-4b58-9628-ff883535a8b8 00000020:00000080:0.0:1788587330.165167:0:9072:0:(genops.c:885:class_export_put()) final put ffff8cbf3c2b0000/2a3fdddd-8216-4b58-9628-ff883535a8b8 00000001:00100000:0.0:1788587330.165200:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 105a14ca-5728-4c79-85fc-db7f7cf354e5 00000020:00000080:0.0:1788587330.165202:0:9072:0:(genops.c:885:class_export_put()) final put ffff8cbe044ff000/105a14ca-5728-4c79-85fc-db7f7cf354e5 00000020:00000080:0.0:1788587330.165216:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3c2b0000/2a3fdddd-8216-4b58-9628-ff883535a8b8 for lustre-OST0001 00000020:00000080:0.0:1788587330.165256:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe044ff000/105a14ca-5728-4c79-85fc-db7f7cf354e5 for lustre-OST0001 00000020:00000080:0.0:1788587330.165282:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3c2b3800 for lustre-OST0001 00000020:00000080:0.0:1788587330.165287:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe044fc000 for lustre-OST0001 00010000:00010000:1.0:1788587330.347933:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788587330.670830:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a3fdddd-8216-4b58-9628-ff883535a8b8 00000020:00000080:2.0:1788587330.670838:0:8130:0:(genops.c:885:class_export_put()) final put ffff8cbf10d09000/2a3fdddd-8216-4b58-9628-ff883535a8b8 00000020:00000080:0.0:1788587330.671180:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf10d09000/2a3fdddd-8216-4b58-9628-ff883535a8b8 for lustre-OST0000 00000020:00000080:0.0:1788587330.671365:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf10d0c800 for lustre-OST0000 00000100:00100000:0.0:1788587331.115157:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310049536:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115229:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115271:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310050048:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115298:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115319:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310050560:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115339:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115354:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310051072:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115374:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115398:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788587331.115404:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310049920:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115429:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115446:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310050432:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115467:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115480:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469310050944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115498:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115535:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310049664:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115570:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115590:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310050176:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115610:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115626:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310050688:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115647:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115659:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788587331.115664:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310049792:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115688:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115700:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310050304:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115719:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115732:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310050816:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115753:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.115777:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310050048 00000100:00100000:0.0:1788587331.115784:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310050048 00000100:00100000:0.0:1788587331.115852:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310050560 00000100:00100000:0.0:1788587331.115856:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310050560 00000100:00100000:0.0:1788587331.115867:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310051072 00000100:00100000:0.0:1788587331.115869:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310051072 00000100:00100000:0.0:1788587331.115890:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310050944 00000100:00100000:0.0:1788587331.115892:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310050944 00000100:00100000:0.0:1788587331.115903:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310050688 00000100:00100000:0.0:1788587331.115905:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310050688 00000100:00100000:0.0:1788587331.115917:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310050816 00000100:00100000:0.0:1788587331.115919:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310050816 00000100:00100000:0.0:1788587331.115933:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788587331.115941:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310050048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.115996:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310050048:12345-0@lo:400:kworker.0 Request processed in 56us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.116017:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788587331.116036:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788587331.116043:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310050560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.116081:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310050560:12345-0@lo:400:kworker.0 Request processed in 39us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.116087:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587331.116092:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310049536 00000100:00100000:0.0:1788587331.116101:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788587331.116103:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310049536 00000100:00100000:0.0:1788587331.116109:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469310051072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587331.116153:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788587331.116164:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf03b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3473:x1875469310049536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.116170:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469310051072:12345-0@lo:400:kworker.0 Request processed in 61us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.116178:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788587331.116190:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788587331.116197:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469310050944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.116219:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469310050944:12345-0@lo:400:kworker.0 Request processed in 24us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.116225:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788587331.116235:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587331.116240:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469310050688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.116269:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469310050688:12345-0@lo:400:kworker.0 Request processed in 30us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.116275:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587331.116285:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788587331.116291:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310050816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.116324:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310050816:12345-0@lo:400:kworker.0 Request processed in 33us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.116337:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788587331.116348:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf03b5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3473:x1875469310049536:12345-0@lo:400:kworker.0 Request processed in 185us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587331.116359:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788587331.116361:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310049920 00000100:00100000:0.0:1788587331.116366:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310049920 00000100:00100000:0.0:1788587331.116394:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310050432 00000100:00100000:0.0:1788587331.116396:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310050432 00000100:00100000:1.0:1788587331.116407:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310049664 00000100:00100000:1.0:1788587331.116414:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310049664 00000100:00100000:0.0:1788587331.116414:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310049792 00000100:00100000:0.0:1788587331.116419:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310049792 00000100:00100000:0.0:1788587331.116437:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310050304 00000100:00100000:0.0:1788587331.116440:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310050304 00000100:00100000:1.0:1788587331.116445:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310050176 00000100:00100000:1.0:1788587331.116450:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310050176 00000100:00100000:0.0:1788587331.116458:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587331.116468:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310049920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587331.116473:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788587331.116484:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310049664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.116504:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310049920:12345-0@lo:400:kworker.0 Request processed in 38us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.116510:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587331.116520:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587331.116526:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310050432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.116549:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310050432:12345-0@lo:400:kworker.0 Request processed in 24us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.116554:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587331.116562:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587331.116567:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310049792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.116588:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310049792:12345-0@lo:400:kworker.0 Request processed in 21us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.116594:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587331.116603:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587331.116608:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310050304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587331.116641:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310049664:12345-0@lo:400:kworker.0 Request processed in 158us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587331.116650:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788587331.116655:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310050304:12345-0@lo:400:kworker.0 Request processed in 45us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.116663:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788587331.116668:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788587331.116677:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310050176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587331.116724:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310050176:12345-0@lo:400:kworker.0 Request processed in 48us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587331.116730:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788587331.116885:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587331.116890:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587331.116892:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587331.116894:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587331.118629:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310051328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587331.118687:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587331.118716:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587331.118722:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310051200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587331.118740:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587331.118768:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310051328 00000100:00100000:2.0:1788587331.118774:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310051328 00000100:00100000:2.0:1788587331.118812:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310051200 00000100:00100000:2.0:1788587331.118815:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310051200 00000100:00100000:2.0:1788587331.118826:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587331.118833:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310051328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587331.118861:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587331.118863:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310049792:0@lo:400:kworker.0 00000100:00100000:2.0:1788587331.118900:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310051328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587331.118906:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587331.118918:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788587331.118923:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310051200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587331.118931:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59441152 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788587331.118951:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310051200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.118955:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310050304:0@lo:400:kworker.0 00000100:00100000:2.0:1788587331.118960:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788587331.118983:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2c700 x1875469310050816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587331.119001:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310051200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587331.119006:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310050816:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.119032:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310049664:0@lo:400:kworker.0 00000100:00100000:1.0:1788587331.119876:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf40c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310051456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587331.120302:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310051328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587331.120823:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310050176:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.120835:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310050688:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.120871:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310049920:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.120878:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310050432:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.120886:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469310050944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.120893:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310049536:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.120900:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310050048:0@lo:400:kworker.0 00000100:00100000:0.0:1788587331.120907:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310050560:0@lo:400:kworker.0 00010000:00080000:0.0:1788587331.120917:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2d180 x1875469310051072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587331.120924:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310051072:0@lo:400:kworker.0 00000100:00100000:1.0:1788587331.124968:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587331.127891:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310051456 00000100:00100000:2.0:1788587331.127905:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310051456 00000100:00100000:2.0:1788587331.127990:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587331.128000:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310051456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587331.128023:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587331.128473:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310051456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 474us (3511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587331.128481:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587331.131505:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf40c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310051456:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788587331.372483:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587331.627418:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310051584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587331.627500:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587331.627657:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310051584 00000100:00100000:3.0:1788587331.627669:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310051584 00000100:00100000:3.0:1788587331.627740:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788587331.627749:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310051584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587331.627817:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788587331.627864:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310051584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587331.627870:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788587331.628008:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310051584:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587331.628378:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310051712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587331.628410:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587331.628450:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310051712 00000100:00100000:0.0:1788587331.628455:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310051712 00000100:00100000:0.0:1788587331.628488:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587331.628498:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310051712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587331.628521:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587331.628561:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310051712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587331.628567:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587331.628609:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310051712:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788587332.395038:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587333.420399:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587334.037497:0:20084:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 01:48:52 (1788587332) 00010000:00010000:1.0:1788587334.443027:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587334.805731:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587334.805786:0:16436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292153600 00000100:00100000:3.0:1788587334.805812:0:16436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292153600 00000100:00100000:0.0:1788587334.805856:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587334.805871:0:16436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 168 00000100:00100000:3.0:1788587334.805883:0:16436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2412:x1875469292153600:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587334.805887:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587334.805913:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587334.805934:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292153728 00000100:00100000:0.0:1788587334.805939:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292153728 00000100:00100000:3.0:1788587334.805972:0:16436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2412:x1875469292153600:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587334.805977:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292153856 00000100:00100000:0.0:1788587334.805981:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292153856 00000100:00100000:3.0:1788587334.805984:0:16436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 168 00000100:00100000:0.0:1788587334.806001:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292154112 00000100:00100000:0.0:1788587334.806005:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292154112 00000100:00100000:0.0:1788587334.806028:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:0.0:1788587334.806037:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+12:2411:x1875469292153728:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587334.806084:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+12:2411:x1875469292153728:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00080000:2.0:1788587334.806516:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587334.806521:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587334.806549:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 77 00000100:00100000:2.0:1788587334.807317:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:2.0:1788587334.807333:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292153856:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587334.807388:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2412:x1875469292153856:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 61us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587334.807400:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:2.0:1788587334.807415:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 78 00000100:00100000:1.0:1788587334.807422:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2412:x1875469292154112:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587334.807459:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2412:x1875469292154112:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 43us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587334.807467:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 79 00000100:00100000:2.0:1788587334.807477:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587334.807533:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587334.807652:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292154240 00000100:00100000:1.0:1788587334.807660:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292154240 00000100:00100000:1.0:1788587334.807701:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:1.0:1788587334.807709:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2411:x1875469292154240:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587334.807728:0:17750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292153984 00000100:00100000:2.0:1788587334.807734:0:17750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292153984 00000100:00100000:1.0:1788587334.807747:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2411:x1875469292154240:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587334.807754:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 80 00000100:00100000:2.0:1788587334.807876:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:2.0:1788587334.807883:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2411:x1875469292153984:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587334.807927:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2411:x1875469292153984:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 44us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587334.807946:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00080000:2.0:1788587334.807964:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587334.807968:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587335.211194:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587335.211218:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310051840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587335.211285:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587335.211404:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310051840 00000100:00100000:3.0:1788587335.211412:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310051840 00000100:00100000:3.0:1788587335.211470:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587335.211479:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310051840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587335.211513:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59441152 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788587335.211572:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310051840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587335.211579:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587335.211620:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310051840:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788587335.211945:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788587335.468268:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587336.107921:0:16478:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788587336.107933:0:16478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587336.107971:0:16478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788587336.107977:0:16478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788587336.235217:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310052096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788587336.235288:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587336.235369:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587336.235376:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310051968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587336.235401:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587336.235453:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310052096 00000100:00100000:0.0:1788587336.235461:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310052096 00000100:00100000:0.0:1788587336.235510:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310051968 00000100:00100000:0.0:1788587336.235514:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310051968 00000100:00100000:0.0:1788587336.235530:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587336.235538:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310052096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788587336.235558:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59441152 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788587336.235600:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310052096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587336.235608:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587336.235624:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587336.235629:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310051968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587336.235652:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587336.235677:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310051968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587336.235699:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788587336.235715:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587336.235719:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587336.235749:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310051968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587336.235763:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310052096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587336.236254:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310052224:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236294:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.236340:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310052736:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236366:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.236384:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310053248:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236405:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.236437:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788587336.236444:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310052352:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236467:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.236482:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310052864:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236528:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.236545:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469310053376:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236565:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.236594:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310052480:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236616:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.236633:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310052992:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236650:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.236662:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310053504:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236681:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.236693:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788587336.236698:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310052608:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236716:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.236734:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310053120:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236753:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.236773:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310052224 00000100:00100000:1.0:1788587336.236779:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310052224 00000100:00100000:1.0:1788587336.236837:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788587336.236847:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3474:x1875469310052224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.236889:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3474:x1875469310052224:12345-0@lo:400:kworker.0 Request processed in 44us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587336.236896:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788587336.237326:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310052736 00000100:00100000:1.0:1788587336.237332:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310052736 00000100:00100000:1.0:1788587336.237357:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310053248 00000100:00100000:1.0:1788587336.237359:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310053248 00000100:00100000:1.0:1788587336.237383:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310053376 00000100:00100000:1.0:1788587336.237393:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310053376 00000100:00100000:3.0:1788587336.237708:0:18542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310052480 00000100:00100000:3.0:1788587336.237713:0:18542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310052480 00000100:00100000:3.0:1788587336.237748:0:18542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310052608 00000100:00100000:3.0:1788587336.237752:0:18542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310052608 00000100:00100000:3.0:1788587336.237777:0:18542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788587336.237784:0:18542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310052480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587336.237853:0:18542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310052480:12345-0@lo:400:kworker.0 Request processed in 69us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587336.237860:0:18542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788587336.237875:0:18542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788587336.237881:0:18542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310052608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587336.237909:0:18542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310052608:12345-0@lo:400:kworker.0 Request processed in 29us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587336.238032:0:18542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587336.242140:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310052992 00000100:00100000:2.0:1788587336.242156:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310052992 00000100:00100000:2.0:1788587336.242200:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310053504 00000100:00100000:2.0:1788587336.242203:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310053504 00000100:00100000:2.0:1788587336.242220:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310053120 00000100:00100000:2.0:1788587336.242223:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310053120 00000100:00100000:2.0:1788587336.242240:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788587336.242251:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310052736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587336.242352:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310052736:12345-0@lo:400:kworker.0 Request processed in 103us (5984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587336.242359:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788587336.242382:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788587336.242390:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310053248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.246447:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788587336.246475:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469310053376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.246563:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3474:x1875469310053376:12345-0@lo:400:kworker.0 Request processed in 104us (9997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587336.246571:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788587336.246599:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788587336.246605:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310052992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.246632:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310052992:12345-0@lo:400:kworker.0 Request processed in 28us (9981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587336.246637:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788587336.246653:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788587336.246659:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310053504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.246684:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310053504:12345-0@lo:400:kworker.0 Request processed in 26us (10002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587336.246689:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788587336.246700:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788587336.246706:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310053120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.246731:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310053120:12345-0@lo:400:kworker.0 Request processed in 26us (9977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587336.246736:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788587336.246810:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310052608:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.246825:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310053120:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.246837:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310052480:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.246866:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310052992:0@lo:400:kworker.0 00010000:00080000:1.0:1788587336.246878:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bd52300 x1875469310053504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587336.246888:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310053504:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.247093:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587336.247115:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310053632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587336.247149:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587336.247194:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310053632 00000100:00100000:1.0:1788587336.247200:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310053632 00000100:00100000:1.0:1788587336.247234:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788587336.247241:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310053632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587336.247257:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587336.247292:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310053632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587336.247297:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788587336.247461:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3474:1875469310053376:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.247479:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310052224:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.247492:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310052736:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.247531:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310053632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587336.247577:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310052352 00000100:00100000:1.0:1788587336.247581:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310052352 00000100:00100000:1.0:1788587336.247601:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310052864 00000100:00100000:1.0:1788587336.247604:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310052864 00000100:00100000:1.0:1788587336.247617:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788587336.247632:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310052352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.247672:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310052352:12345-0@lo:400:kworker.0 Request processed in 42us (11204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587336.247679:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788587336.247693:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788587336.247698:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310052864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.247726:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310052864:12345-0@lo:400:kworker.0 Request processed in 28us (11198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587336.247732:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788587336.247764:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310052352:0@lo:400:kworker.0 00000100:00100000:1.0:1788587336.247775:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310052864:0@lo:400:kworker.0 00000100:00080000:1.0:1788587336.247840:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587336.247845:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587336.247848:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587336.247934:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310053248:12345-0@lo:400:kworker.0 Request processed in 5543us (11526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587336.247941:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1788587336.249610:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bd51500 x1875469310053248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587336.249627:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310053248:0@lo:400:kworker.0 00010000:00010000:1.0:1788587336.491045:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587336.747290:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310053888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587336.747290:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310053760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587336.747666:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587336.747947:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310053888 00000100:00100000:0.0:1788587336.747956:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310053888 00000100:00100000:0.0:1788587336.748138:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788587336.748149:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310053888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587336.748187:0:16447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587336.748250:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310053888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587336.748258:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587336.748322:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587336.748388:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310053888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587336.756962:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310053760 00000100:00100000:2.0:1788587336.757036:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310053760 00000100:00100000:2.0:1788587336.757107:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788587336.757117:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310053760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587336.757161:0:16448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587336.757326:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310053760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 210us (9002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587336.757348:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587336.761413:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310053760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587337.427204:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587337.427458:0:16445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292154496 00000100:00100000:3.0:1788587337.427468:0:16445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292154496 00000100:00100000:3.0:1788587337.427544:0:16445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:3.0:1788587337.427555:0:16445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+12:16622:x1875469292154496:12345-192.168.203.14@tcp:35:umount.0 00000100:00080000:1.0:1788587337.427992:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788587337.428256:0:16445:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788587337.428423:0:16445:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:3.0:1788587337.428707:0:16445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:105a14ca-5728-4c79-85fc-db7f7cf354e5+15:16622:x1875469292154496:12345-192.168.203.14@tcp:35:umount.0 Request processed in 1151us (1509us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1788587337.428717:0:16445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000020:00080000:3.0:1788587337.428722:0:16445:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788587337.437578:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587337.437618:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587337.437647:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587337.437686:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587337.437721:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292155008 00000100:00100000:0.0:1788587337.437730:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292155008 00000100:00100000:0.0:1788587337.437841:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:0.0:1788587337.437851:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2408:x1875469292155008:12345-192.168.203.14@tcp:9:umount.0 00000020:00000080:0.0:1788587337.437886:0:17877:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344e26 00000100:00080000:0.0:1788587337.437895:0:17877:0:(import.c:65:import_set_state_nolock()) ffff8cbe044f8000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788587337.438010:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292154624 00000100:00100000:1.0:1788587337.438025:0:16428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292154624 00000100:00100000:1.0:1788587337.438065:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292154880 00000100:00100000:1.0:1788587337.438068:0:16428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292154880 00000100:00100000:1.0:1788587337.438085:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292154752 00000100:00100000:1.0:1788587337.438099:0:16428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292154752 00000100:00100000:1.0:1788587337.438115:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:1.0:1788587337.438122:0:16428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+15:2412:x1875469292154624:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587337.438137:0:16428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587337.438155:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f26a00/0x419e1ae1f6344e03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5bb0 expref: 15 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587337.438173:0:16428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587337.438222:0:16428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+14:2412:x1875469292154624:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 100us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587337.438229:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:1.0:1788587337.438246:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:1.0:1788587337.438252:0:16428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+13:2412:x1875469292154880:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587337.438259:0:16428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587337.438268:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482600/0x419e1ae1f6344e8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c97 expref: 13 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587337.438277:0:16428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587337.438294:0:16428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+12:2412:x1875469292154880:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 43us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587337.438300:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:1.0:1788587337.438322:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:1.0:1788587337.438329:0:16428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:2412:x1875469292154752:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587337.438344:0:16428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587337.438353:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f6344e0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5be1 expref: 11 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587337.438369:0:16428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587337.438387:0:16428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:2412:x1875469292154752:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 59us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587337.438393:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00010000:00010000:1.0:1788587337.438524:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587337.438536:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1788587337.438980:0:17877:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934606 00000100:00100000:0.0:1788587337.439295:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+2:2408:x1875469292155008:12345-192.168.203.14@tcp:9:umount.0 Request processed in 1443us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587337.439322:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:0.0:1788587337.459968:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587337.460058:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292155904 00000100:00100000:1.0:1788587337.460067:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292155904 00000100:00100000:1.0:1788587337.460138:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 65 00000100:00100000:1.0:1788587337.460148:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+15:2408:x1875469292155904:12345-192.168.203.14@tcp:39:umount.0 00000020:00000080:1.0:1788587337.460181:0:16444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344e18 00000020:00010000:1.0:1788587337.460195:0:16444:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbe03db2800: total 0 00000100:00080000:1.0:1788587337.460200:0:16444:0:(import.c:65:import_set_state_nolock()) ffff8cbf39156000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788587337.460233:0:16444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1788587337.460551:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:105a14ca-5728-4c79-85fc-db7f7cf354e5+14:2408:x1875469292155904:12345-192.168.203.14@tcp:39:umount.0 Request processed in 403us (591us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1788587337.460558:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 65 00000020:00010000:2.0:1788587337.461314:0:16430:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbe03db2800: total 0 00010000:00010000:2.0:1788587337.461321:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587337.461364:0:16430:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbe03db2800, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1788587337.461396:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbf20ad1f00) 00010000:00010000:2.0:1788587337.461400:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587337.461408:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18a00/0x419e1ae1f6344ee3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c9e expref: 13 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587337.461433:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbf02c76600) 00010000:00010000:2.0:1788587337.461436:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788587337.461440:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6344fc3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cdd expref: 12 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587337.461453:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbf20ad1200) 00010000:00010000:2.0:1788587337.461455:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587337.461458:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f63450bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d2a expref: 11 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587337.461472:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:2.0:1788587337.461474:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587337.461477:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345041 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d07 expref: 10 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587337.461488:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf20ad1900) 00010000:00010000:2.0:1788587337.461490:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587337.461505:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18c00/0x419e1ae1f6344eff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ca5 expref: 9 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587337.461543:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf20ad1a00) 00010000:00010000:2.0:1788587337.461546:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587337.461549:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19800/0x419e1ae1f6344f3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cb3 expref: 8 pid: 16443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587337.461558:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbf03ac7700) 00010000:00010000:2.0:1788587337.461561:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587337.461564:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482400/0x419e1ae1f6345064 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d15 expref: 7 pid: 17774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587337.461575:0:16430:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbe03db2800, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1788587337.461586:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587337.461588:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587337.461589:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587337.476878:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587337.477060:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292156032 00000100:00100000:1.0:1788587337.477071:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292156032 00000100:00100000:1.0:1788587337.477149:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 66 00000100:00100000:1.0:1788587337.477160:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+5:2408:x1875469292156032:12345-192.168.203.14@tcp:39:umount.0 00000020:00000080:1.0:1788587337.477193:0:17774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344e1f 00000100:00080000:1.0:1788587337.477209:0:17774:0:(import.c:65:import_set_state_nolock()) ffff8cbe053cd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788587337.477252:0:17774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788587337.477673:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:105a14ca-5728-4c79-85fc-db7f7cf354e5+3:2408:x1875469292156032:12345-192.168.203.14@tcp:39:umount.0 Request processed in 513us (802us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788587337.477681:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 66 00010000:00010000:0.0:1788587337.477899:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587337.478269:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788587337.515058:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587337.643831:0:17096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788587338.539324:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587339.552887:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587339.553584:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587339.559461:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587339.559647:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292156160 00000100:00100000:1.0:1788587339.559657:0:16428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292156160 00000100:00100000:1.0:1788587339.559790:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292156416 00000100:00100000:1.0:1788587339.559809:0:16428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292156416 00000100:00100000:2.0:1788587339.560102:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:2.0:1788587339.560116:0:16429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe040bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+11:2409:x1875469292156160:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587339.560133:0:16429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587339.560154:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f26000/0x419e1ae1f6344e42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c20 expref: 11 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587339.560173:0:16429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587339.560244:0:16429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe040bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+10:2409:x1875469292156160:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 131us (7366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587339.560272:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:2.0:1788587339.560524:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788587339.560533:0:16429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+9:2409:x1875469292156416:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587339.560541:0:16429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587339.560551:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf3ccf3600/0x419e1ae1f6344e88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c90 expref: 9 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587339.560560:0:16429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587339.560579:0:16429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:2409:x1875469292156416:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 48us (6998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587339.560586:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:3.0:1788587339.563136:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587339.563514:0:16428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292156288 00000100:00100000:1.0:1788587339.563526:0:16428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292156288 00000100:00100000:1.0:1788587339.563581:0:16428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:1.0:1788587339.563591:0:16428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+8:2409:x1875469292156288:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587339.563606:0:16428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587339.563623:0:16428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044800/0x419e1ae1f6344e49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5c51 expref: 8 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587339.563638:0:16428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587339.563665:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292156672 00000100:00100000:0.0:1788587339.563672:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292156672 00000100:00100000:1.0:1788587339.563706:0:16428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+7:2409:x1875469292156288:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 114us (4266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587339.563715:0:16428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00080000:1.0:1788587339.563749:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587339.563790:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 67 00000100:00100000:0.0:1788587339.563828:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+6:2408:x1875469292156672:12345-192.168.203.14@tcp:39:umount.0 00000020:00000080:0.0:1788587339.563860:0:16444:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344e57 00000020:00010000:0.0:1788587339.563869:0:16444:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbf3b268800: total 0 00000100:00080000:0.0:1788587339.563873:0:16444:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788587339.563896:0:16444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:1.0:1788587339.564114:0:16430:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbf3b268800: total 0 00010000:00010000:1.0:1788587339.564156:0:16430:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbf3b268800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788587339.564184:0:16430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf20ad1a00) 00010000:00010000:1.0:1788587339.564188:0:16430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587339.564195:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483e00/0x419e1ae1f6344f4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5cba expref: 5 pid: 16444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587339.564215:0:16430:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbf3b268800, canceled 1 locks, left on hash table 0. 00000100:00100000:0.0:1788587339.564222:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a3fdddd-8216-4b58-9628-ff883535a8b8+4:2408:x1875469292156672:12345-192.168.203.14@tcp:39:umount.0 Request processed in 395us (1094us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788587339.564230:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 67 00010000:00010000:1.0:1788587339.564255:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587339.564258:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587339.564262:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587339.564632:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587339.575175:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587339.575911:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292156800 00000100:00100000:1.0:1788587339.575923:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292156800 00000100:00100000:1.0:1788587339.576437:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00100000:1.0:1788587339.576459:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+5:2408:x1875469292156800:12345-192.168.203.14@tcp:39:umount.0 00000020:00000080:1.0:1788587339.576903:0:17774:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344e5e 00000100:00080000:1.0:1788587339.576916:0:17774:0:(import.c:65:import_set_state_nolock()) ffff8cbf3b2fb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788587339.576959:0:17774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788587339.577335:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a3fdddd-8216-4b58-9628-ff883535a8b8+3:2408:x1875469292156800:12345-192.168.203.14@tcp:39:umount.0 Request processed in 885us (2165us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788587339.577345:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 68 00000100:00080000:2.0:1788587339.577552:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788587339.578331:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587339.618925:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587339.619165:0:16435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292157056 00000100:00100000:2.0:1788587339.619174:0:16435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292157056 00000100:00100000:2.0:1788587339.619277:0:16435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 170 00000100:00100000:2.0:1788587339.619289:0:16435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+7:2408:x1875469292157056:12345-192.168.203.14@tcp:251:umount.0 00000020:00000080:2.0:1788587339.619337:0:16435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344df5 00000020:00010000:2.0:1788587339.619345:0:16435:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbf3c2b1800: total 0 00000100:00080000:2.0:1788587339.619349:0:16435:0:(import.c:65:import_set_state_nolock()) ffff8cbf3c2b4000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788587339.619423:0:16435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed+3:2408:x1875469292157056:12345-192.168.203.14@tcp:251:umount.0 Request processed in 136us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587339.619431:0:16435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 170 00000020:00010000:1.0:1788587339.619705:0:16431:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbf3c2b1800: total 0 00010000:00010000:1.0:1788587339.619710:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587339.619753:0:16431:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbf3c2b1800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788587339.619785:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f26400/0x419e1ae1f6344dfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ba9 expref: 2 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587339.619965:0:16431:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbf3c2b1800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788587339.619980:0:16431:0:(genops.c:885:class_export_put()) final put ffff8cbf3c2b1800/330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed 00010000:00010000:2.0:1788587339.620035:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788587339.620036:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3c2b1800/330e3fa4-c5ee-4d7c-b38f-12ac5b3777ed for MGS 00010000:00010000:2.0:1788587339.620038:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587339.620053:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788587339.620128:0:19211:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3c2b4000 for MGS 00000100:00100000:2.0:1788587340.343886:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587340.343913:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310054016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587340.343987:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587340.346050:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310054016 00000100:00100000:1.0:1788587340.346061:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310054016 00000100:00100000:1.0:1788587340.346141:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788587340.346151:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310054016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587340.346188:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788587340.346263:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310054016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587340.346690:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587340.347860:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310054016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788587340.350589:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788587340.397472:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a3fdddd-8216-4b58-9628-ff883535a8b8 00000001:00080000:1.0:1788587340.397489:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:1.0:1788587340.397493:0:6494:0:(genops.c:885:class_export_put()) final put ffff8cbf3b268800/2a3fdddd-8216-4b58-9628-ff883535a8b8 00000001:00100000:1.0:1788587340.397682:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 105a14ca-5728-4c79-85fc-db7f7cf354e5 00000001:00080000:1.0:1788587340.397698:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1788587340.397712:0:6494:0:(genops.c:885:class_export_put()) final put ffff8cbe03db2800/105a14ca-5728-4c79-85fc-db7f7cf354e5 00000020:00000080:2.0:1788587340.397746:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b268800/2a3fdddd-8216-4b58-9628-ff883535a8b8 for lustre-MDT0000 00000020:00000080:2.0:1788587340.397824:0:19211:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf10d0d800 for lustre-MDT0000 00000020:00000080:0.0:1788587340.398750:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03db2800/105a14ca-5728-4c79-85fc-db7f7cf354e5 for lustre-MDT0000 00000020:00000080:0.0:1788587340.398988:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf39156000 for lustre-MDT0000 00010000:00010000:0.0:1788587340.587104:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788587340.905663:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 105a14ca-5728-4c79-85fc-db7f7cf354e5 00000020:00000080:3.0:1788587340.905673:0:8130:0:(genops.c:885:class_export_put()) final put ffff8cbf164fc000/105a14ca-5728-4c79-85fc-db7f7cf354e5 00000020:00000080:3.0:1788587340.905702:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf164fc000/105a14ca-5728-4c79-85fc-db7f7cf354e5 for lustre-OST0000 00000020:00000080:3.0:1788587340.905747:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe044f8000 for lustre-OST0000 00000020:01000004:2.0:1788587341.333873:0:20284:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788587341.349408:0:20284:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788587341.349520:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587341.349613:0:20284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587341.349622:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587341.349629:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587341.349652:0:20284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788587341.349658:0:20284:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788587341.349681:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587341.349685:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788587341.349691:0:20284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788587341.349718:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788587341.349789:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587341.349814:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.349822:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587341.349826:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.349834:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587341.349841:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587341.349846:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788587341.349849:0:16431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788587341.349851:0:16431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788587341.349876:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.349882:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788587341.349940:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310054272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587341.350003:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587341.350027:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469310054144:0@lo:39:umount.0 00000100:00100000:1.0:1788587341.350059:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587341.350112:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310054144 00000100:00100000:1.0:1788587341.350119:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310054144 00010000:00010000:2.0:1788587341.350152:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.350172:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26200/0x419e1ae1f63449b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f63449bf expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.350187:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587341.350189:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587341.350190:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587341.350250:0:18483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310054272 00000100:00100000:3.0:1788587341.350255:0:18483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310054272 00000100:00100000:1.0:1788587341.350274:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788587341.350285:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1875469310054144:12345-0@lo:39:umount.0 00000100:00100000:3.0:1788587341.350287:0:18483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587341.350293:0:18483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3473:x1875469310054272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587341.350303:0:18483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1788587341.350309:0:16442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63449e9 00000100:00080000:1.0:1788587341.350317:0:16442:0:(import.c:65:import_set_state_nolock()) ffff8cbf11b4b000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788587341.350318:0:18483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63449bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f63449b8 expref: 24 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587341.350332:0:18483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587341.350370:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3471:x1875469310054144:12345-0@lo:39:umount.0 Request processed in 86us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587341.350377:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:00000080:1.0:1788587341.350386:0:16442:0:(genops.c:885:class_export_put()) final put ffff8cbf11b4a800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1788587341.353361:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788587341.353426:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469310054144:0@lo:39:umount.0 00010000:00010000:1.0:1788587341.353476:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788587341.353490:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf11b4a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788587341.353543:0:19211:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf11b4b000 for lustre-MDT0000 00000100:00080000:2.0:1788587341.353587:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587341.353591:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788587341.353595:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788587341.355125:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355214:0:20284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355223:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355231:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355257:0:20284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587341.355274:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587341.355280:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355288:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27600 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587341.355292:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355314:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587341.355321:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587341.355328:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788587341.355330:0:16431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788587341.355361:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355368:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788587341.355425:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310054400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587341.355496:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587341.355557:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355566:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f6344909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344910 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355579:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587341.355580:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587341.355582:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587341.355598:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355606:0:20284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355700:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355716:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355728:0:20284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587341.355734:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355740:0:20284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355746:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355751:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355760:0:20284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788587341.355766:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587341.355769:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355775:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc1cf1c20) 00010000:00010000:0.0:1788587341.355777:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1788587341.355778:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355785:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587341.355790:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587341.355810:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310054400 10000000:01000000:2.0:1788587341.355816:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1788587341.355816:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310054400 10000000:01000000:2.0:1788587341.355818:0:16431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788587341.355820:0:16431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788587341.355835:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.355840:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788587341.355911:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587341.355918:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310054528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587341.355919:0:18483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3473:x1875469310054272:12345-0@lo:103:ldlm_bl.0 Request processed in 5623us (5914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587341.355942:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587341.355960:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3474:x1875469310054400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587341.355971:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587341.355984:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf3ccf2a00/0x419e1ae1f6344910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6344909 expref: 24 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587341.355997:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587341.356011:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587341.356034:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:3474:x1875469310054400:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587341.356048:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310054400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587341.356223:0:16428:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788587341.356231:0:16428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1788587341.356248:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310054272:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587341.356387:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587341.356392:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587341.356399:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42045800 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587341.356402:0:16430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587341.356409:0:16430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587341.356416:0:16430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587341.356421:0:16430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788587341.356423:0:16430:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788587341.356425:0:16430:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788587341.356439:0:16430:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587341.356445:0:16430:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788587341.356465:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587341.356471:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42045800/0x419e1ae1f6344ec0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344ec7 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587341.356487:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587341.356488:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587341.356490:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587341.356494:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587341.356502:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310054656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587341.356526:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587341.356541:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587341.356543:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587341.356556:0:16429:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788587341.356562:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310054528 00000100:00100000:1.0:1788587341.356565:0:16429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310054528 00010000:00010000:2.0:1788587341.356602:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.356620:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03482a00/0x419e1ae1f6344de7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344dee expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.356629:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587341.356630:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587341.356632:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587341.356651:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.356657:0:20284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.356663:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.356668:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.356678:0:20284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788587341.356686:0:20284:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788587341.356690:0:20284:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788587341.356714:0:20284:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788587341.356717:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788587341.356721:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587341.356726:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1788587341.356731:0:20284:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cbe05878800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587341.356735:0:20284:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cbe0362f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587341.356739:0:20284:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cbf10958000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587341.356743:0:20284:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cbf1095c800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587341.356748:0:20284:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8cbe044f4d40) has exports, disconnecting them 00000020:00080000:2.0:1788587341.356752:0:20284:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cbe05878800), last request at 1788587336 00000020:00000080:2.0:1788587341.356757:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344cdd 00000100:00080000:2.0:1788587341.356769:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8cbe0587e000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788587341.356837:0:20284:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe05878800): rc 0 00000020:00000080:2.0:1788587341.356841:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbe05878800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788587341.356850:0:20284:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cbe0362f800), last request at 1788587336 00000020:00000080:2.0:1788587341.356853:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344b86 00000100:00080000:2.0:1788587341.356858:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8cbe0362e800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788587341.356869:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587341.356874:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.356879:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587341.356882:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.356889:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587341.356901:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587341.356906:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788587341.356908:0:16431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788587341.356910:0:16431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788587341.356924:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.356930:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587341.357102:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.357109:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27200/0x419e1ae1f63448fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344902 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587341.357119:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587341.357120:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587341.357122:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587341.357127:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587341.357136:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310054784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587341.357181:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788587341.357206:0:20284:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe0362f800): rc 0 00000020:00000080:2.0:1788587341.357208:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbe0362f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788587341.357213:0:20284:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cbf10958000), last request at 1788587275 00000020:00000080:2.0:1788587341.357216:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344ad7 00000100:00080000:2.0:1788587341.357220:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8cbf1095c000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788587341.357232:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788587341.357239:0:20284:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf10958000): rc 0 00000020:00000080:2.0:1788587341.357246:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf10958000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788587341.357251:0:20284:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cbf1095c800), last request at 1788587275 00000020:00000080:2.0:1788587341.357254:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344a7c 00000100:00080000:2.0:1788587341.357257:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8cbf10958800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788587341.357266:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788587341.357272:0:20284:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:2.0:1788587341.357519:0:20284:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf1095c800): rc 0 00000004:00000080:2.0:1788587341.357525:0:20284:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb6254626bae0 00000100:00080000:2.0:1788587341.357541:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587341.357544:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788587341.357902:0:18483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587341.358113:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587341.358133:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310054656 00000100:00100000:0.0:1788587341.358138:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310054656 00000100:00100000:0.0:1788587341.358161:0:16427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310054784 00000100:00100000:0.0:1788587341.358164:0:16427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310054784 00000100:00100000:0.0:1788587341.358176:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587341.358183:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+24:3473:x1875469310054656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587341.358194:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587341.358207:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044600/0x419e1ae1f6344ec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6344ec0 expref: 24 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587341.358234:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587341.358276:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+23:3473:x1875469310054656:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587341.358282:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587341.358292:0:16427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587341.358297:0:16427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe040bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+22:3472:x1875469310054784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587341.358305:0:16427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587341.358313:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf3ccf3c00/0x419e1ae1f6344902 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f63448fb expref: 22 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587341.358331:0:16427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587341.358355:0:16427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe040bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+21:3472:x1875469310054784:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587341.358361:0:16427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587341.358662:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310054912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587341.358696:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587341.358731:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310054912 00000100:00100000:3.0:1788587341.358734:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310054912 00000100:00100000:3.0:1788587341.358766:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788587341.358772:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310054912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587341.358789:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788587341.358873:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3473:1875469310054656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587341.358933:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310054912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 160us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587341.358940:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788587341.358956:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587341.358968:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310055040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587341.358995:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587341.359037:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310054784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587341.359156:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587341.359161:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788587341.359176:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe05878800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1788587341.359275:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310054912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587341.359291:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310055040 00000100:00100000:3.0:1788587341.359294:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310055040 00000100:00100000:3.0:1788587341.359316:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587341.359322:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310055040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587341.359342:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788587341.359349:0:20284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788587341.359362:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8cbf05497800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788587341.359372:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310055040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587341.359378:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788587341.359389:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587341.359419:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310055040:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788587341.359474:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788587341.359478:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1788587341.359491:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788587341.359547:0:20284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788587341.359556:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8cbf0a386800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788587341.359561:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788587341.359563:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1788587341.359569:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:0.0:1788587341.359619:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe0362f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1788587341.359624:0:20284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788587341.359630:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:0.0:1788587341.359644:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf10958000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:2.0:1788587341.359652:0:20284:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cbe044f4d40) has no exports 00000020:00000080:0.0:1788587341.359662:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe0587e000 for lustre-MDT0000 00000020:00000080:0.0:1788587341.359666:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe0362e800 for lustre-MDT0000 00000020:00000080:0.0:1788587341.359669:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf1095c000 for lustre-MDT0000 00000100:00100000:0.0:1788587341.359772:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310055168:0@lo:39:umount.0 00000100:00100000:0.0:1788587341.359819:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587341.359838:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310055296:0@lo:9:umount.0 00000100:00100000:0.0:1788587341.359859:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587341.359872:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310055424:0@lo:9:umount.0 00000100:00100000:0.0:1788587341.359889:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587341.359967:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587341.359974:0:16429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+20:3474:x1875469310054528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587341.359984:0:16429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587341.359999:0:16429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044400/0x419e1ae1f6344dee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x419e1ae1f6344de7 expref: 20 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587341.360046:0:16448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310055168 00000100:00100000:2.0:1788587341.360051:0:16448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310055168 00000100:00100000:2.0:1788587341.360098:0:16448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788587341.360104:0:16448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1875469310055168:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788587341.360123:0:16448:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344b01 00000100:00080000:2.0:1788587341.360129:0:16448:0:(import.c:65:import_set_state_nolock()) ffff8cbf41b12800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788587341.360191:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310055808:0@lo:400:kworker.0 00000100:00100000:3.0:1788587341.360230:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587341.360257:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:0:1875469310056320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587341.360269:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587341.360273:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310055936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587341.360293:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587341.360319:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310055808 00000100:00100000:3.0:1788587341.360322:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310055808 00000100:00100000:3.0:1788587341.360341:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310055936 00000100:00100000:3.0:1788587341.360343:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310055936 00000100:00100000:3.0:1788587341.360365:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788587341.360370:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310055936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587341.360407:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310055936:12345-0@lo:400:kworker.0 Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587341.360414:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788587341.360426:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788587341.360430:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3474:x1875469310055808:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788587341.360435:0:16443:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000001:00000004:2.0:1788587341.360574:0:16448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:0.0:1788587341.360651:0:16429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587341.360701:0:16429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:3474:x1875469310054528:12345-0@lo:103:ldlm_bl.0 Request processed in 727us (4688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587341.360708:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788587341.360862:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310055296 00000100:00100000:0.0:1788587341.360866:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310055296 00000100:00100000:0.0:1788587341.360888:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310055424 00000100:00100000:0.0:1788587341.360891:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310055424 00000100:00100000:2.0:1788587341.360902:0:16448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3471:x1875469310055168:12345-0@lo:39:umount.0 Request processed in 798us (1082us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788587341.360909:0:16448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788587341.360909:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587341.360914:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3471:x1875469310055296:12345-0@lo:9:umount.0 00000100:00100000:2.0:1788587341.360928:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000020:00000080:0.0:1788587341.360928:0:17751:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344bc5 00000100:00080000:0.0:1788587341.360936:0:17751:0:(import.c:65:import_set_state_nolock()) ffff8cbe05870800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788587341.361362:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3474:x1875469310055808:12345-0@lo:400:kworker.0 Request processed in 928us (1130us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788587341.361370:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788587341.361394:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587341.361397:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788587341.361420:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2e680 x1875469310055936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587341.361432:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310055936:0@lo:400:kworker.0 00000100:00080000:3.0:1788587341.361442:0:3474:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788587341.361518:0:3474:0:(import.c:65:import_set_state_nolock()) ffff8cbe044fa000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788587341.361523:0:3474:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000001:00000004:0.0:1788587341.361874:0:17751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934606 00000100:00100000:2.0:1788587341.362035:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3471:x1875469310055424:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788587341.362056:0:17753:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344d00 00000100:00080000:2.0:1788587341.362063:0:17753:0:(import.c:65:import_set_state_nolock()) ffff8cbe0362b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587341.362104:0:17753:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788587341.362388:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3471:x1875469310055296:12345-0@lo:9:umount.0 Request processed in 1472us (2526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587341.362397:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587341.362457:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3471:x1875469310055424:12345-0@lo:9:umount.0 Request processed in 1522us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587341.362463:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788587341.362489:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310055552:0@lo:400:kworker.0 00000100:00100000:2.0:1788587341.362521:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587341.362545:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469310056064:0@lo:400:kworker.0 00000100:00100000:2.0:1788587341.362566:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587341.362587:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788587341.362593:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310055680:0@lo:400:kworker.0 00000100:00100000:2.0:1788587341.362612:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587341.362629:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310056192:0@lo:400:kworker.0 00000100:00100000:2.0:1788587341.362648:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587341.362674:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310055552 00000100:00100000:2.0:1788587341.362687:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310055552 00000100:00100000:2.0:1788587341.362711:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788587341.362717:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3472:x1875469310055552:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788587341.362722:0:16447:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788587341.362752:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3472:x1875469310055552:12345-0@lo:400:kworker.0 Request processed in 34us (230us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788587341.362758:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:2.0:1788587341.362772:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587341.362821:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf05497800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788587341.362828:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310055168:0@lo:39:umount.0 00000100:00080000:2.0:1788587341.362840:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf0a386800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788587341.362850:0:3471:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788587341.362852:0:3471:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587341.362854:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310055296:0@lo:9:umount.0 00000100:00080000:2.0:1788587341.362865:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10f58000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788587341.362872:0:3471:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788587341.362874:0:3471:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587341.362876:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310055424:0@lo:9:umount.0 00000100:00080000:2.0:1788587341.362907:0:3472:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788587341.362911:0:3472:0:(import.c:65:import_set_state_nolock()) ffff8cbf10959800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788587341.362914:0:3472:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788587341.362918:0:3472:0:(import.c:65:import_set_state_nolock()) ffff8cbf10959800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587341.362921:0:3472:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:2.0:1788587341.362926:0:3472:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cbf10959800 using connection 192.168.203.114@tcp/0@lo 00010000:00010000:0.0:1788587341.363339:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587341.363345:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587341.363386:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310055680 00000100:00100000:0.0:1788587341.363391:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310055680 00000100:00100000:0.0:1788587341.363408:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310056192 00000100:00100000:0.0:1788587341.363410:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310056192 00000100:00100000:1.0:1788587341.363456:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310056064 00000100:00100000:1.0:1788587341.363462:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310056064 00000100:00100000:1.0:1788587341.363481:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788587341.363486:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3472:x1875469310055680:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788587341.363492:0:17774:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788587341.363526:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3472:x1875469310055680:12345-0@lo:400:kworker.0 Request processed in 38us (912us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788587341.363532:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788587341.363544:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587341.363548:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3472:x1875469310056064:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788587341.363551:0:17774:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788587341.363573:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3472:x1875469310056064:12345-0@lo:400:kworker.0 Request processed in 23us (1005us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788587341.363588:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587341.363873:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788587341.363880:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310056192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587341.363917:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310056192:12345-0@lo:400:kworker.0 Request processed in 39us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587341.363923:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788587341.364095:0:3472:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf340c2680 x1875469310056448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587341.364124:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310055552:0@lo:400:kworker.0 00000100:00080000:2.0:1788587341.364149:0:3472:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788587341.364153:0:3472:0:(import.c:65:import_set_state_nolock()) ffff8cbe05877800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788587341.364156:0:3472:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788587341.364160:0:3472:0:(import.c:65:import_set_state_nolock()) ffff8cbe05877800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587341.364163:0:3472:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1788587341.364168:0:3472:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cbe05877800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587341.364183:0:3472:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf340c0e00 x1875469310056576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587341.364192:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469310056064:0@lo:400:kworker.0 00000100:00080000:2.0:1788587341.364214:0:3472:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788587341.364217:0:3472:0:(import.c:65:import_set_state_nolock()) ffff8cbf05220000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788587341.364220:0:3472:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788587341.364223:0:3472:0:(import.c:65:import_set_state_nolock()) ffff8cbf05220000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587341.364226:0:3472:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:2.0:1788587341.364229:0:3472:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cbf05220000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587341.364242:0:3472:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe06895c00 x1875469310056704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587341.364252:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310055680:0@lo:400:kworker.0 00010000:00080000:2.0:1788587341.364265:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf36a15f80 x1875469310056192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587341.364287:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310056192:0@lo:400:kworker.0 00000100:00100000:2.0:1788587341.364309:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310056448:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788587341.364343:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587341.364363:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310056576:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788587341.364383:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587341.364399:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310056704:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788587341.364417:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587341.364442:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310056576 00000100:00100000:2.0:1788587341.364447:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310056576 00000100:00100000:2.0:1788587341.364466:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310056704 00000100:00100000:2.0:1788587341.364469:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310056704 00000100:00100000:2.0:1788587341.364573:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587341.364578:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe04fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3471:x1875469310056576:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788587341.364592:0:16444:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788587341.364698:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788587341.364703:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf40c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310056704:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788587341.364711:0:16442:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788587341.364746:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf40c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310056704:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 42us (328us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788587341.364753:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788587341.364777:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf05220000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587341.364781:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587341.364784:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310056704:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788587341.364992:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310056448 00000100:00100000:0.0:1788587341.364997:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310056448 00000100:00100000:0.0:1788587341.367767:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788587341.367781:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310056448:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788587341.367809:0:16447:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788587341.367905:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310056448:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 126us (3561us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788587341.367913:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788587341.367992:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10959800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587341.368010:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788587341.369008:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310056448:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788587341.376263:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587341.380882:0:3474:0:(import.c:65:import_set_state_nolock()) ffff8cbe044fa000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587341.380893:0:3474:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 484 00000100:00080000:3.0:1788587341.380902:0:3474:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cbe044fa000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587341.380947:0:3474:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d54e00 x1875469310056832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587341.380981:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310055808:0@lo:400:kworker.0 00000100:00100000:1.0:1788587341.381022:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310056832:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788587341.381024:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310054528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587341.381099:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587341.381875:0:16442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310056832 00000100:00100000:3.0:1788587341.381883:0:16442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310056832 00000100:00100000:3.0:1788587341.381917:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788587341.381923:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310056832:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788587341.381940:0:16442:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788587341.381991:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310056832:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 66us (891us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587341.381998:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788587341.382638:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe044fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587341.382644:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788587341.382648:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310056832:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788587341.395619:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe04fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3471:x1875469310056576:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 31031us (31225us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788587341.395633:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788587341.395683:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe05877800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587341.395689:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788587341.395693:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310056576:0@lo:38:ptlrpcd_00_00.0 00000020:00080000:2.0:1788587341.396385:0:20284:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cbe044f4d40) has no exports 00000020:00000080:2.0:1788587341.436444:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344956 00000020:00000080:2.0:1788587341.436460:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf0a387000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788587341.436478:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788587341.436484:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587341.436505:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587341.436508:0:20284:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8cbe037ab380) has no exports 00000020:00000080:2.0:1788587341.437223:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634494f 00000020:00000080:2.0:1788587341.437230:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf195f9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788587341.437391:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587341.437400:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788587341.438034:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0a387000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788587341.438041:0:36:0:(genops.c:885:class_export_put()) final put ffff8cbf3ceea800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788587341.438043:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3ceea800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788587341.438052:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788587341.438172:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf195f9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:0.0:1788587341.456106:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2a3fdddd-8216-4b58-9628-ff883535a8b8 00000001:00080000:0.0:1788587341.456133:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1788587341.456351:0:7270:0:(genops.c:885:class_export_put()) final put ffff8cbf3b2fe000/2a3fdddd-8216-4b58-9628-ff883535a8b8 00000001:00100000:0.0:1788587341.456376:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 105a14ca-5728-4c79-85fc-db7f7cf354e5 00000001:00080000:0.0:1788587341.456383:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1788587341.456385:0:7270:0:(genops.c:885:class_export_put()) final put ffff8cbe053cf000/105a14ca-5728-4c79-85fc-db7f7cf354e5 00000020:00000080:2.0:1788587341.456432:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b2fe000/2a3fdddd-8216-4b58-9628-ff883535a8b8 for lustre-MDT0001 00000020:00000080:2.0:1788587341.456560:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe053cf000/105a14ca-5728-4c79-85fc-db7f7cf354e5 for lustre-MDT0001 00000020:00000080:2.0:1788587341.456580:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3b2fb000 for lustre-MDT0001 00000020:00000080:2.0:1788587341.456584:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe053cd000 for lustre-MDT0001 00010000:00010000:2.0:1788587341.610939:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587342.635053:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587343.658974:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587344.682954:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587345.504267:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587345.504276:0:6494:0:(genops.c:885:class_export_put()) final put ffff8cbf1095c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788587345.504338:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf1095c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788587345.504386:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf10958800 for lustre-MDT0000 00000001:00100000:1.0:1788587345.511748:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587345.511758:0:9072:0:(genops.c:885:class_export_put()) final put ffff8cbe03629800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788587345.511842:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03629800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788587345.511895:0:19211:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe0362b800 for lustre-OST0001 00010000:00010000:0.0:1788587345.707053:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788587346.036818:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788587346.036828:0:8130:0:(genops.c:885:class_export_put()) final put ffff8cbe05876000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587346.036904:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe05876000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788587346.037197:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe05870800 for lustre-OST0000 00000100:00100000:1.0:1788587346.475101:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587346.475453:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310057088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587346.475515:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587346.475746:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310057088 00000100:00100000:3.0:1788587346.475755:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310057088 00000100:00100000:3.0:1788587346.475842:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587346.475861:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310057088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587346.475895:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587346.475944:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310057088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587346.476122:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587346.476176:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10947480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310057088:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788587346.476333:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587346.476354:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587346.476359:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788587346.476363:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10959800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788587346.476365:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788587346.476370:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 539 00000100:00080000:0.0:1788587346.476376:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1788587346.476378:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf36a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310057216:0@lo:400:kworker.0 00000100:00080000:0.0:1788587346.476384:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cbf10959800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587346.476406:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf340c0e00 x1875469310057344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587346.476419:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587346.476453:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310057344:0@lo:38:kworker.0 00000100:00100000:2.0:1788587346.476478:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587346.476506:0:16437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310057216 00000100:00100000:3.0:1788587346.476512:0:16437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310057216 00000100:00100000:3.0:1788587346.476548:0:16437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788587346.476556:0:16437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ccec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:3472:x1875469310057216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587346.476603:0:16437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ccec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:524e146e-34e9-4e2a-818d-ac1a7cb53ea4+19:3472:x1875469310057216:12345-0@lo:400:kworker.0 Request processed in 48us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587346.476609:0:16437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788587346.476658:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf36a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310057216:0@lo:400:kworker.0 00000100:00100000:3.0:1788587346.476703:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310057344 00000100:00100000:3.0:1788587346.476707:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310057344 00000100:00100000:3.0:1788587346.476726:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788587346.476731:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310057344:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788587346.476744:0:16447:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788587346.484026:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310057472:0@lo:400:kworker.0 00000100:00100000:1.0:1788587346.484124:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587346.484171:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310056960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587346.484196:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587346.484256:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310057472 00000100:00100000:1.0:1788587346.484264:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310057472 00000100:00100000:1.0:1788587346.484320:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788587346.484329:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310057472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587346.484381:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310057472:12345-0@lo:400:kworker.0 Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587346.484388:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788587346.484412:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310056960 00000100:00100000:1.0:1788587346.484415:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310056960 00000100:00100000:1.0:1788587346.484437:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788587346.484444:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310056960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788587346.484473:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788587346.484505:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310056960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587346.484511:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788587346.484549:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310057472:0@lo:400:kworker.0 00000100:00100000:1.0:1788587346.484565:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310056960:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788587346.485377:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587346.486649:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587346.486656:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788587346.486659:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf05220000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587346.486667:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 539 00000100:00080000:0.0:1788587346.486672:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587346.486678:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cbf05220000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587346.486728:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf340c2680 x1875469310057600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587346.486749:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587346.486752:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788587346.486754:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbe044fa000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587346.486756:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 539 00000100:00080000:0.0:1788587346.486759:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587346.486763:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cbe044fa000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587346.486776:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310057600:0@lo:38:kworker.0 00000100:00100000:0.0:1788587346.486852:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587346.486895:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310057600 00000100:00100000:0.0:1788587346.486901:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310057600 00000100:00100000:0.0:1788587346.486932:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788587346.486939:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310057600:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788587346.487098:0:16443:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788587346.487141:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310057600:12345-0@lo:38:kworker.0 Request processed in 200us (287us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788587346.487148:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788587346.487181:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf05220000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587346.487185:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788587346.487189:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310057600:0@lo:38:kworker.0 00000100:00100000:0.0:1788587346.488092:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf340c2680 x1875469310057728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587346.488134:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587346.488138:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788587346.488149:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbe05877800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587346.488153:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 539 00000100:00080000:0.0:1788587346.488156:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587346.488160:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cbe05877800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587346.488171:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469310057856:0@lo:400:kworker.0 00000100:00100000:0.0:1788587346.488210:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587346.488270:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf41a2ce00 x1875469310057984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587346.488319:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310058112:0@lo:400:kworker.0 00000100:00100000:0.0:1788587346.488343:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587346.488372:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310057856 00000100:00100000:0.0:1788587346.488377:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310057856 00000100:00100000:0.0:1788587346.488413:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310058112 00000100:00100000:0.0:1788587346.488416:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310058112 00000100:00100000:0.0:1788587346.488435:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788587346.488443:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469310057856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587346.488486:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469310057856:12345-0@lo:400:kworker.0 Request processed in 43us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587346.488492:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788587346.488505:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788587346.488510:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310058112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587346.488540:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310058112:12345-0@lo:400:kworker.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587346.488545:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1788587346.488575:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03da2680 x1875469310057856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587346.488598:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469310057856:0@lo:400:kworker.0 00000100:00080000:0.0:1788587346.488619:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788587346.488636:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2e680 x1875469310058112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587346.488645:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310058112:0@lo:400:kworker.0 00000100:00100000:2.0:1788587346.489067:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310057728:0@lo:38:kworker.0 00000100:00100000:2.0:1788587346.489242:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587346.489317:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310057984:0@lo:38:kworker.0 00000100:00100000:2.0:1788587346.489341:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587346.493700:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310057344:12345-0@lo:38:kworker.0 Request processed in 16959us (17213us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587346.493714:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788587346.493933:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10959800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587346.493940:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788587346.493944:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310057344:0@lo:38:kworker.0 00000100:00100000:1.0:1788587346.494095:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310057728 00000100:00100000:1.0:1788587346.494103:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310057728 00000100:00100000:0.0:1788587346.494181:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310057984 00000100:00100000:0.0:1788587346.494186:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310057984 00000100:00100000:0.0:1788587346.494230:0:16442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788587346.494238:0:16442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310057728:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788587346.494340:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788587346.494347:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310057984:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788587346.494366:0:16443:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1788587346.494403:0:16442:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788587346.494409:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310057984:12345-0@lo:38:kworker.0 Request processed in 59us (5064us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788587346.494417:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788587346.494446:0:16442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310057728:12345-0@lo:38:kworker.0 Request processed in 207us (5203us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788587346.494454:0:16442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788587346.501557:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe044fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587346.501571:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788587346.501576:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310057728:0@lo:38:kworker.0 00000100:00080000:2.0:1788587346.501591:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe05877800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587346.501594:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788587346.501709:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310057984:0@lo:38:kworker.0 00000001:00100000:3.0:1788587346.525583:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788587346.525602:0:7270:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788587346.525608:0:7270:0:(genops.c:885:class_export_put()) final put ffff8cbf1095b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788587346.526943:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf1095b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788587346.527039:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf41b12800 for lustre-MDT0001 00010000:00010000:0.0:1788587346.731353:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788587347.501335:0:20284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf3a405ea0 - data ffff8cbf3fed0288/ffff8cbf39423000 00000020:01000000:0.0:1788587347.501493:0:20284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf3cd95900 - data ffff8cbf021d0ca8/ffff8cbf057ae400 00000001:00000004:0.0:1788587347.513485:0:20284:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1788587347.672552:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788587347.672576:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788587347.672593:0:20284:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8cbf340c0380 x1875469310055168/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788587351 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587347.672626:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788587347.675208:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788587347.675216:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788587347.675243:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587347.675246:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788587347.675619:0:16466:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788587347.675624:0:16466:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1788587347.675637:0:16466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788587347.683095:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788587347.683103:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788587347.683118:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587347.683120:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788587347.684397:0:16468:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788587347.684403:0:16468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1788587347.684414:0:16468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788587347.772766:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634491e 00000020:00000080:0.0:1788587347.772779:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf05495000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788587347.773589:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344933 00000020:00000080:0.0:1788587347.773596:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf3b87e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788587347.773613:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788587347.773618:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587347.773626:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788587347.773630:0:20284:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8cbe044f19c0) has no exports 00000004:01000000:0.0:1788587347.773790:0:20284:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788587347.773822:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344995 00000020:00000080:0.0:1788587347.773827:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf3b87b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788587347.773830:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788587347.773834:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587347.773839:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788587347.773842:0:20284:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8cbf33b0cd40) has no exports 00000020:00000080:0.0:1788587347.773848:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634498e 00000020:00000080:0.0:1788587347.773851:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf10f59000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788587347.774193:0:20284:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788587347.774198:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788587347.774202:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1788587347.774207:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788587347.774209:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788587347.774235:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587347.774241:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788587347.774245:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344980 00000020:00000080:0.0:1788587347.774249:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf3b878800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788587347.774253:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788587347.774256:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587347.774259:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788587347.774261:0:20284:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8cbe044f3380) has no exports 00000020:00000080:0.0:1788587347.774264:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344979 00000020:00000080:0.0:1788587347.774267:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf0a385800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788587347.774568:0:20284:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788587347.774572:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788587347.774574:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1788587347.774577:0:20284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788587347.774585:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788587347.774607:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587347.774612:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788587347.774620:0:20284:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788587347.774625:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634496b 00000020:00000080:0.0:1788587347.774629:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf3b87a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788587347.774632:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788587347.774635:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587347.774639:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788587347.774641:0:20284:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8cbf3b888000) has no exports 00000020:00000080:0.0:1788587347.774644:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344964 00000020:00000080:0.0:1788587347.774647:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf05497000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788587347.775623:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf05495000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788587347.775640:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b87e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788587347.775649:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b87b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788587347.775654:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf10f59000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788587347.775660:0:19211:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf10f58000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788587347.775666:0:19211:0:(genops.c:885:class_export_put()) final put ffff8cbf3b87f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788587347.775668:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b87f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788587347.775673:0:19211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587347.775740:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b878800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788587347.775746:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0a385800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788587347.775751:0:19211:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf0a386800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788587347.775754:0:19211:0:(genops.c:885:class_export_put()) final put ffff8cbf3b879000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788587347.775756:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b879000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788587347.775759:0:19211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587347.775785:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b87a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788587347.775789:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf05497000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788587347.807269:0:20284:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788587347.807289:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788587347.807294:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788587347.807301:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788587347.807359:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587347.807371:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788587347.807401:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587347.807404:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788587347.807410:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbe05da8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587347.807415:0:20284:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe05da8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788587347.807427:0:20284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788587347.807523:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f634493a 00000020:00000080:1.0:1788587347.807530:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf3b87b000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788587347.807536:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788587347.807540:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587347.807544:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788587347.807547:0:20284:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8cbe044f0000) has no exports 00000020:00000080:1.0:1788587347.807568:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587347.807571:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788587347.807574:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344941 00000020:00000080:1.0:1788587347.807578:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbe040c6800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788587347.807584:0:20284:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe04f8d000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788587347.807587:0:20284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe04f8d000 3 00000020:01000004:1.0:1788587347.807590:0:20284:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbe04f8d000 from lustre-MDT0000 00000020:00000080:1.0:1788587347.807609:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587347.807612:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788587347.807614:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf05492000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788587347.807616:0:20284:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf05492000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788587347.807622:0:20284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788587347.807645:0:20284:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788587347.807649:0:20284:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788587347.807651:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788587347.807653:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587347.807661:0:20284:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788587347.807667:0:20284:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8cbe066fe000 524e146e-34e9-4e2a-818d-ac1a7cb53ea4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587347.807673:0:20284:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8cbf41a30000) has exports, disconnecting them 00000020:00080000:1.0:1788587347.807677:0:20284:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cbe066fe000), last request at 1788587263 00000020:00000080:1.0:1788587347.807689:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63448e6 00000020:00010000:1.0:1788587347.807693:0:20284:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbe066fe000: total 2 00000100:00080000:1.0:1788587347.807697:0:20284:0:(import.c:65:import_set_state_nolock()) ffff8cbe066fe800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788587347.807709:0:20284:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe066fe000): rc 0 00000020:00080000:1.0:1788587347.807713:0:20284:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8cbf41a30000) has no exports 00000100:00100000:3.0:1788587347.807879:0:16436:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cbf0a250200:16436] 1 exiting: rc = 0 00000100:00100000:3.0:1788587347.807957:0:16437:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cbf07c1f800:16437] 2 exiting: rc = 0 00000100:00100000:3.0:1788587347.808009:0:16435:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cbe05a90400:16435] 0 exiting: rc = 1 00000020:00000080:3.0:1788587347.808051:0:19211:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf05497800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788587347.808056:0:19211:0:(genops.c:885:class_export_put()) final put ffff8cbf0a380000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788587347.808059:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf0a380000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788587347.808063:0:19211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587347.808120:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b87b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788587347.808124:0:19211:0:(genops.c:885:class_export_put()) final put ffff8cbf3b878000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788587347.808125:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b878000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788587347.808130:0:19211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788587347.808151:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe040c6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788587347.808428:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808436:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808442:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808448:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808454:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808460:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808466:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808472:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808477:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808485:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808490:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808496:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808501:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808507:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808513:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808519:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808528:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808534:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808539:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808544:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808549:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808554:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808559:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808563:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808580:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808585:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808591:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808596:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808603:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808609:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808614:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808620:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808625:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808630:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808636:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808642:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808647:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808652:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808658:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808663:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808669:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808674:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808680:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808685:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808692:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808697:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808703:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808708:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808713:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808718:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808724:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808729:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808734:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808739:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808746:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808750:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808755:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808761:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808766:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808778:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808784:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808815:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808822:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587347.808829:0:20284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788587347.809223:0:20284:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788587347.809227:0:20284:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1788587347.811440:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbf3ccf2000/0x419e1ae1f6344a05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f63449fe expref: 14 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811468:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf3ccf2000/0x419e1ae1f6344a05 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f63449fe expref: 14 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811485:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbf0499f400/0x419e1ae1f63448f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f63448ed expref: 13 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811493:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499f400/0x419e1ae1f63448f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f63448ed expref: 13 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811502:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6344a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f6344a1a expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811510:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6344a21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f6344a1a expref: 12 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811519:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbf3ccf2600/0x419e1ae1f6344ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f6344abb expref: 11 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811528:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf3ccf2600/0x419e1ae1f6344ac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f6344abb expref: 11 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811536:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbe05f26c00/0x419e1ae1f6344b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f6344b40 expref: 10 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811564:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f26c00/0x419e1ae1f6344b47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f6344b40 expref: 10 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811575:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f6344b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f6344b6a expref: 9 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811583:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f6344b71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f6344b6a expref: 9 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811591:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f6344c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f6344c97 expref: 8 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811599:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f6344c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f6344c97 expref: 8 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811607:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbf0499fe00/0x419e1ae1f6344cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f6344cc1 expref: 7 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811614:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499fe00/0x419e1ae1f6344cc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f6344cc1 expref: 7 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811625:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbf3ccf2400/0x419e1ae1f6344de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f6344dd9 expref: 6 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811633:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf3ccf2400/0x419e1ae1f6344de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f6344dd9 expref: 6 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811643:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbe062ae600/0x419e1ae1f6344a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f6344a0c expref: 5 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811663:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe062ae600/0x419e1ae1f6344a13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f6344a0c expref: 5 pid: 16437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811674:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6344e9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f6344e96 expref: 4 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811682:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482200/0x419e1ae1f6344e9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f6344e96 expref: 4 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811690:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbf0499e400/0x419e1ae1f6344eab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f6344ea4 expref: 3 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811699:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499e400/0x419e1ae1f6344eab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f6344ea4 expref: 3 pid: 16435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811708:0:20284:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6344eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x419e1ae1f6344eb2 expref: 2 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587347.811715:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6344eb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x419e1ae1f6344eb2 expref: 2 pid: 16436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1788587347.813866:0:16431:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbe066fe000: total 0 00010000:00010000:3.0:1788587347.813923:0:16431:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbe066fe000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788587347.813938:0:16431:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbe066fe000, canceled 0 locks, left on hash table 0. 00000020:00000080:3.0:1788587347.813946:0:16431:0:(genops.c:885:class_export_put()) final put ffff8cbe066fe000/524e146e-34e9-4e2a-818d-ac1a7cb53ea4 00010000:00010000:3.0:1788587347.813968:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587347.813970:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587347.813972:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788587347.814050:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe066fe000/524e146e-34e9-4e2a-818d-ac1a7cb53ea4 for MGS 00000020:00000080:1.0:1788587347.814083:0:19211:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe066fe800 for MGS 00000040:00080000:3.0:1788587347.885397:0:17096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788587348.098496:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587349.099214:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788587349.867116:0:20284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf304f1420 - data ffff8cbf2fb95bd0/ffff8cbf3b32cc00 00000020:01000000:1.0:1788587349.867267:0:20284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf0570e6c0 - data ffff8cbf3cbdbaf8/ffff8cbe040b9c00 00000020:00000080:1.0:1788587349.867751:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63448ca 00000020:00000080:1.0:1788587349.867759:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbe04f8e000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788587349.867784:0:20284:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe04f8d000 from MGS, refs=2 00000020:01000004:1.0:1788587349.867788:0:20284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe04f8d000 2 00000020:01000004:1.0:1788587349.867843:0:20284:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbe04f8d000 from MGS 00000020:00000080:1.0:1788587349.867864:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587349.867870:0:20284:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788587349.867874:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbe04f89800/MGS 00000020:00000080:1.0:1788587349.867876:0:20284:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe04f89800/MGS for MGS 00000020:01000000:1.0:1788587349.867883:0:20284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788587349.867932:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788587349.867935:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587349.867940:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788587349.867946:0:20284:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cbf3e05c000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587349.867952:0:20284:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8cbf062b99c0) has exports, disconnecting them 00000020:00080000:1.0:1788587349.867958:0:20284:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cbf3e05c000), last request at 1788587264 00000020:00000080:1.0:1788587349.867961:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63449cd 00000020:00080000:1.0:1788587349.867970:0:20284:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf3e05c000): rc 0 00000020:00000080:1.0:1788587349.867973:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbf3e05c000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788587349.868835:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe04f8e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587349.868849:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3e05c000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788587349.869104:0:20284:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788587349.869108:0:20284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587349.869112:0:20284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788587349.869117:0:20284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788587349.869290:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587349.869297:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788587349.869302:0:20284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe04f8d000 1 00000020:00000080:0.0:1788587349.869307:0:20284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63448bc 00000020:00000080:0.0:1788587349.869312:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbe04f8a000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788587349.869316:0:20284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788587349.869321:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587349.869323:0:20284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788587349.869326:0:20284:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8cbf41a319c0) has no exports 00000020:00000080:2.0:1788587349.869458:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe03e1c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788587349.869465:0:36:0:(genops.c:885:class_export_put()) final put ffff8cbe03e18000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788587349.869467:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03e18000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788587349.869471:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788587349.869534:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe04f8a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788587349.892664:0:20284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587349.892677:0:20284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788587349.892682:0:20284:0:(genops.c:885:class_export_put()) final put ffff8cbe04f8e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788587349.892687:0:20284:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe04f8e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788587349.892700:0:20284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788587349.892883:0:20284:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cbe04f8d800 00000020:02000400:0.0:1788587349.892945:0:20284:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788587350.124082:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587351.159823:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587351.596924:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587351.596932:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788587351.596936:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10959800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587351.596945:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 544 00000100:00080000:1.0:1788587351.596950:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788587351.596957:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cbf10959800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587351.596977:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf07c2e680 x1875469310058368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587351.597024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587351.597027:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788587351.597042:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf05220000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587351.597046:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 544 00000100:00080000:1.0:1788587351.597049:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788587351.597059:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cbf05220000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587351.597072:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe06895c00 x1875469310058752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587351.597081:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587351.597084:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788587351.597085:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbe044fa000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587351.597088:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 544 00000100:00080000:1.0:1788587351.597091:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788587351.597093:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cbe044fa000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587351.597102:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf3bd51500 x1875469310058880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587351.597116:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587351.597119:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788587351.597121:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbe05877800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587351.597124:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 544 00000100:00080000:1.0:1788587351.597127:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788587351.597129:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cbe05877800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587351.597138:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf3bd50e00 x1875469310059136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587351.597292:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310058496:0@lo:400:kworker.0 00000100:00100000:1.0:1788587351.597354:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587351.597404:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587351.597410:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310058624:0@lo:400:kworker.0 00000100:00100000:1.0:1788587351.597431:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587351.598353:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310059392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587351.598388:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587351.598428:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310059392 00000100:00100000:3.0:1788587351.598437:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310059392 00000100:00100000:3.0:1788587351.598486:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788587351.598495:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310059392:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587351.602211:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310058368:0@lo:38:kworker.0 00000100:00100000:2.0:1788587351.602291:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587351.602341:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe06895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310058752:0@lo:38:kworker.0 00000100:00100000:2.0:1788587351.602368:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587351.602387:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310058880:0@lo:38:kworker.0 00000100:00100000:2.0:1788587351.602409:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587351.602481:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310059136:0@lo:38:kworker.0 00000100:00100000:2.0:1788587351.602504:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587351.602554:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310058496 00000100:00100000:2.0:1788587351.602562:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310058496 00000100:00100000:2.0:1788587351.602605:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310058624 00000100:00100000:2.0:1788587351.602608:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310058624 00000100:00100000:2.0:1788587351.602638:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788587351.602647:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3474:x1875469310058496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587351.608123:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310058752 00000100:00100000:0.0:1788587351.608138:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310058752 00000100:00100000:0.0:1788587351.608190:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310058880 00000100:00100000:0.0:1788587351.608194:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310058880 00000100:00100000:0.0:1788587351.608202:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310059136 00000100:00100000:0.0:1788587351.608205:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310059136 00000100:00100000:0.0:1788587351.608219:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788587351.608227:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3471:x1875469310058752:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788587351.608251:0:17774:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788587351.613086:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310058368 00000100:00100000:3.0:1788587351.613107:0:16447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310058368 00000100:00100000:3.0:1788587351.613159:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788587351.613167:0:16447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310058368:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788587351.613189:0:16447:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788587351.613276:0:16447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310058368:12345-0@lo:38:kworker.0 Request processed in 108us (10985us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587351.613283:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00002000:00000024:3.0:1788587351.613725:0:17754:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788587351.613777:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36a15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3474:x1875469310059392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 15282us (15386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587351.613785:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788587351.613857:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310059392:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788587351.614107:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10959800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587351.614113:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788587351.614116:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310058368:0@lo:38:kworker.0 00000100:00100000:2.0:1788587351.614145:0:17750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788587351.614157:0:17750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310058624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587351.614221:0:17750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310058624:12345-0@lo:400:kworker.0 Request processed in 59us (16778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587351.614227:0:17750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788587351.614309:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788587351.614325:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310058880:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788587351.614342:0:16443:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788587351.614378:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310058880:12345-0@lo:38:kworker.0 Request processed in 52us (11967us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788587351.614385:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788587351.614401:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788587351.614406:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310059136:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788587351.614416:0:16443:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788587351.614454:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310059136:12345-0@lo:38:kworker.0 Request processed in 46us (11949us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788587351.614460:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788587351.614778:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe044fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587351.614784:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788587351.614788:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310058880:0@lo:38:kworker.0 00000100:00080000:2.0:1788587351.614820:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe05877800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587351.614828:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788587351.614832:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310059136:0@lo:38:kworker.0 00000100:00100000:2.0:1788587351.615361:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310058496:12345-0@lo:400:kworker.0 Request processed in 12714us (18004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587351.615370:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587351.616257:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310058624:0@lo:400:kworker.0 00000100:00100000:3.0:1788587351.616273:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310058496:0@lo:400:kworker.0 00000100:00100000:3.0:1788587351.616296:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587351.616309:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310059520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587351.616363:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587351.616409:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310059520 00000100:00100000:2.0:1788587351.616416:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310059520 00000100:00100000:2.0:1788587351.616674:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587351.616685:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310059520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788587351.616727:0:17755:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587351.616788:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310059520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587351.616821:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788587351.617195:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310059520:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788587351.618698:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587351.618706:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587351.618728:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310059008:0@lo:400:kworker.0 00000100:00100000:1.0:1788587351.618785:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587351.618840:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788587351.618848:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310058240:0@lo:400:kworker.0 00000400:00000100:1.0:1788587351.618868:0:3472:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469310058240 offset 0 length 224: 4 00000100:00100000:1.0:1788587351.618888:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310059264:0@lo:400:kworker.0 00000100:00100000:1.0:1788587351.618909:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587351.618937:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310059008 00000100:00100000:1.0:1788587351.618943:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310059008 00000100:00100000:1.0:1788587351.618979:0:16443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310059264 00000100:00100000:1.0:1788587351.618982:0:16443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310059264 00000100:00100000:1.0:1788587351.619009:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788587351.619018:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310059008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587351.619077:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310059008:12345-0@lo:400:kworker.0 Request processed in 61us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587351.619084:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788587351.619101:0:16443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788587351.619107:0:16443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310059264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587351.619134:0:16443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310059264:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587351.619139:0:16443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788587351.619156:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788587351.619874:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8cbf3bd52680 x1875469310059264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587351.619899:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310059264:0@lo:400:kworker.0 00010000:00080000:3.0:1788587351.619913:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8cbf3bd51880 x1875469310059008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587351.619921:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310059008:0@lo:400:kworker.0 00000100:00100000:0.0:1788587351.642307:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3471:x1875469310058752:12345-0@lo:38:kworker.0 Request processed in 34070us (39927us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788587351.642322:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788587351.642889:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf05220000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587351.642896:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587351.642901:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe06895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310058752:0@lo:38:kworker.0 00010000:00010000:0.0:1788587352.176073:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788587353.005278:0:20442:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788587353.019973:0:20442:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788587353.020032:0:20442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.020046:0:20442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.020053:0:20442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.020059:0:20442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.020078:0:20442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788587353.020082:0:20442:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788587353.020101:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587353.020105:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788587353.020111:0:20442:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788587353.020116:0:20442:0:(import.c:65:import_set_state_nolock()) ffff8cbf05220000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788587353.020120:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587353.020122:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788587353.020124:0:20442:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788587353.021152:0:20442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021166:0:20442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021172:0:20442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021193:0:20442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021215:0:20442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587353.021221:0:20442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021228:0:20442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021233:0:20442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021239:0:20442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021253:0:20442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788587353.021259:0:20442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021266:0:20442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021272:0:20442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021277:0:20442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021296:0:20442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788587353.021301:0:20442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021308:0:20442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021314:0:20442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021320:0:20442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587353.021326:0:20442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1788587353.021328:0:20442:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788587353.021347:0:20442:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788587353.021351:0:20442:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788587353.021354:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587353.021359:0:20442:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00010000:00010000:2.0:1788587353.021476:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788587353.021483:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021491:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe062afa00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587353.021494:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021502:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587353.021509:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587353.021514:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788587353.021516:0:16431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788587353.021518:0:16431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788587353.021550:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021556:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587353.021577:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021594:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe062afa00/0x419e1ae1f6344abb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344ac2 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021607:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788587353.021616:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021621:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587353.021623:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021629:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587353.021635:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587353.021639:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788587353.021641:0:16431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1788587353.021642:0:16431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1788587353.021657:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021661:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587353.021667:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021672:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27c00/0x419e1ae1f6344a1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344a21 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021679:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788587353.021682:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021686:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42045200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587353.021700:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021707:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587353.021712:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587353.021718:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788587353.021720:0:16431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788587353.021721:0:16431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788587353.021734:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021740:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587353.021755:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021762:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42045200/0x419e1ae1f6344dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344de0 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021783:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587353.021786:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021790:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044000 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587353.021809:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021816:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587353.021828:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587353.021832:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788587353.021834:0:16431:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788587353.021836:0:16431:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788587353.021850:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021855:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587353.021861:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021867:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42044000/0x419e1ae1f6344eb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344eb9 expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021875:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587353.021877:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021883:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27400 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587353.021886:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021892:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587353.021898:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587353.021912:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788587353.021914:0:16431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788587353.021915:0:16431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788587353.021929:0:16431:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021935:0:16431:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587353.021940:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021946:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27400/0x419e1ae1f6344a0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x419e1ae1f6344a13 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587353.021957:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587353.021959:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587353.021960:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587353.021980:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310059648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587353.022052:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587353.022090:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310060160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587353.022109:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587353.022131:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587353.022137:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310059776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587353.022156:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587353.022183:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310059904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587353.022203:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587353.022220:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587353.022225:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310060032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587353.022251:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587353.022280:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310059648 00000100:00100000:2.0:1788587353.022287:0:16429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310059648 00000100:00100000:2.0:1788587353.022313:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310060160 00000100:00100000:2.0:1788587353.022316:0:16429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310060160 00000100:00100000:2.0:1788587353.022323:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310059776 00000100:00100000:2.0:1788587353.022325:0:16429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310059776 00000100:00100000:2.0:1788587353.022330:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310059904 00000100:00100000:2.0:1788587353.022332:0:16429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310059904 00000100:00100000:2.0:1788587353.022338:0:16429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310060032 00000100:00100000:2.0:1788587353.022340:0:16429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310060032 00000100:00100000:2.0:1788587353.022352:0:16429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587353.022358:0:16429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3472:x1875469310059648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788587353.022364:0:16429:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587353 with bad export cookie 4728246216586184934 00010000:00010000:0.0:1788587353.023675:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587353.023685:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587353.023715:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587353.023723:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3472:x1875469310060160:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788587353.023730:0:20286:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587353 with bad export cookie 4728246216586184934 00000100:00100000:0.0:1788587353.023890:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10945c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3472:x1875469310060160:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (1778us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788587353.023897:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587353.023920:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587353.023923:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10947100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3472:x1875469310059776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788587353.023927:0:20286:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587353 with bad export cookie 4728246216586184934 00000100:00100000:0.0:1788587353.023955:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10947100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3472:x1875469310059776:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (1799us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788587353.023975:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587353.023999:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587353.024004:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3474:x1875469310059904:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788587353.024008:0:20286:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587353 with bad export cookie 4728246216586184934 00000100:00100000:0.0:1788587353.024045:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3474:x1875469310059904:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (1840us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788587353.024051:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587353.024063:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587353.024067:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3474:x1875469310060032:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788587353.024071:0:20286:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587353 with bad export cookie 4728246216586184934 00000100:00100000:0.0:1788587353.024095:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3474:x1875469310060032:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (1844us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788587353.024101:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:00080000:1.0:1788587353.024301:0:20442:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8cbe053ce800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587353.024309:0:20442:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8cbe05872800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587353.024314:0:20442:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8cbf3b8899c0) has exports, disconnecting them 00000020:00080000:1.0:1788587353.024319:0:20442:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8cbe053ce800), last request at 1788587351 00000020:00000080:1.0:1788587353.024328:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344cf2 00000100:00080000:1.0:1788587353.024345:0:20442:0:(import.c:65:import_set_state_nolock()) ffff8cbe053cd800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788587353.024541:0:3472:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788587353.024549:0:3472:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788587353.024552:0:3472:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.114@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788587353.024627:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788587353.024678:0:20442:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe053ce800): rc 0 00000020:00000080:1.0:1788587353.024681:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbe053ce800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788587353.024749:0:20442:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8cbe05872800), last request at 1788587351 00000020:00000080:1.0:1788587353.024761:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344b9b 00000100:00080000:1.0:1788587353.024767:0:20442:0:(import.c:65:import_set_state_nolock()) ffff8cbe05873000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788587353.024778:0:20442:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe05872800): rc 0 00000020:00000080:1.0:1788587353.024780:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbe05872800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788587353.024786:0:20442:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb62542a6fae0 00000100:00080000:1.0:1788587353.024846:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:0.0:1788587353.024883:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe053ce800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:1.0:1788587353.024902:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000020:00000080:0.0:1788587353.025151:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe05872800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788587353.025174:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe053cd800 for lustre-MDT0001 00000020:00000080:0.0:1788587353.025178:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe05873000 for lustre-MDT0001 00010000:00010000:0.0:1788587353.025189:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587353.026170:0:20442:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788587353.026178:0:20442:0:(import.c:65:import_set_state_nolock()) ffff8cbf10959800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788587353.027283:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788587353.027289:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1788587353.027313:0:20442:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788587353.030243:0:20442:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788587353.030280:0:20442:0:(import.c:65:import_set_state_nolock()) ffff8cbf3abbe000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788587353.030310:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788587353.030314:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788587353.030331:0:20442:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788587353.030374:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310060288:0@lo:9:umount.0 00000100:00100000:0.0:1788587353.030442:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587353.030499:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310060288 00000100:00100000:0.0:1788587353.030506:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310060288 00000100:00100000:0.0:1788587353.030659:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587353.030669:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1875469310060288:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788587353.030703:0:17751:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344d07 00000100:00080000:1.0:1788587353.030774:0:20442:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788587353.030785:0:20442:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e18800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788587353.030834:0:20442:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8cbf3b8899c0) has no exports 00000100:00080000:1.0:1788587353.030866:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587353.030885:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310060416:0@lo:9:umount.0 00000100:00100000:1.0:1788587353.030916:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788587353.031233:0:17751:0:(import.c:65:import_set_state_nolock()) ffff8cbe0362c800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788587353.031275:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788587353.031342:0:17751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934606 00000100:00100000:0.0:1788587353.031907:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3471:x1875469310060288:12345-0@lo:9:umount.0 Request processed in 1238us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587353.031917:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587353.031935:0:17751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310060416 00000100:00100000:0.0:1788587353.031940:0:17751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310060416 00000100:00100000:0.0:1788587353.031978:0:17751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587353.031998:0:17751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3471:x1875469310060416:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788587353.032013:0:17751:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344d0e 00000100:00080000:0.0:1788587353.032019:0:17751:0:(import.c:65:import_set_state_nolock()) ffff8cbe03629000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788587353.032040:0:17751:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:1.0:1788587353.032336:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3abbe000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788587353.032349:0:3471:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788587353.032351:0:3471:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788587353.032355:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310060288:0@lo:9:umount.0 00010000:00010000:1.0:1788587353.032674:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587353.033185:0:16438:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587353.034330:0:17751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3471:x1875469310060416:12345-0@lo:9:umount.0 Request processed in 2339us (3407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587353.034342:0:17751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788587353.035132:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e18800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788587353.035140:0:3471:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788587353.035142:0:3471:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788587353.035147:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310060416:0@lo:9:umount.0 00000100:00080000:0.0:1788587353.039497:0:3474:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1788587353.045922:0:16429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3472:x1875469310059648:12345-0@lo:103:ldlm_bl.0 Request processed in 23554us (23862us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788587353.045937:0:16429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788587353.083368:0:3472:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.114@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788587353.083373:0:3472:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788587353.083383:0:3472:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf07c2ea00 x1875469310058240/t0(0) o400->MGC192.168.203.114@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788587367 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587353.083397:0:3472:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf10944000 x1875469310059648/t0(0) o103->MGC192.168.203.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587369 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587353.083407:0:3472:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf10945180 x1875469310060160/t0(0) o103->MGC192.168.203.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587369 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587353.083415:0:3472:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf10945f80 x1875469310059776/t0(0) o103->MGC192.168.203.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587369 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587353.083422:0:3472:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf10944380 x1875469310059904/t0(0) o103->MGC192.168.203.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587369 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587353.083431:0:3472:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf10946d80 x1875469310060032/t0(0) o103->MGC192.168.203.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587369 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788587353.083478:0:3474:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8cbe040c6000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788587353.083555:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310059904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587353.083594:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3474:1875469310060032:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1788587353.085323:0:3472:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788587353.085332:0:3472:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788587353.085334:0:3472:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788587353.085339:0:3472:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587353.085349:0:3472:0:(import.c:545:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 461 00000100:00080000:3.0:1788587353.085361:0:3472:0:(import.c:665:import_select_connection()) MGC192.168.203.114@tcp: import ffff8cbe040c6000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587353.085693:0:3472:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf10946d80 x1875469310060544/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587353.085744:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310059648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587353.085753:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310060160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587353.085766:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310058240:0@lo:400:kworker.0 00000100:00100000:2.0:1788587353.085822:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3472:1875469310059776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587353.085903:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3471:1875469310060544:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788587353.085954:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469310060544 offset 0 length 520: 4 00000020:00080000:1.0:1788587353.100408:0:20442:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8cbf3b8899c0) has no exports 00000020:01000000:0.0:1788587353.178221:0:20442:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf057f6e40 - data ffff8cbf0780c438/ffff8cbe03c8ac00 00000020:01000000:0.0:1788587353.178397:0:20442:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf126b82a0 - data ffff8cbf07882af8/ffff8cbf18309c00 00010000:00010000:0.0:1788587353.194971:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788587353.196138:0:20442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788587353.305074:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587353.305083:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788587353.305103:0:20442:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788587353.313668:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788587353.313677:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788587353.314340:0:20442:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587353.314344:0:20442:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788587353.323326:0:17083:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788587353.323336:0:17083:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788587353.323355:0:17083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788587353.327480:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788587353.327488:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788587353.327600:0:20442:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587353.327603:0:20442:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788587353.328869:0:17086:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788587353.328875:0:17086:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1788587353.328909:0:17086:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788587353.425153:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344a2f 00000020:00000080:3.0:1788587353.425175:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf3abbf000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788587353.425229:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3abbf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788587353.426125:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344a44 00000020:00000080:3.0:1788587353.426133:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf391ea800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788587353.426146:0:20442:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788587353.426153:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587353.426174:0:20442:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788587353.426179:0:20442:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8cbf3b88cd40) has no exports 00000020:00000080:2.0:1788587353.426279:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf391ea800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1788587353.426345:0:20442:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788587353.426353:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344a98 00000020:00000080:3.0:1788587353.426357:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf41b13000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788587353.426371:0:20442:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788587353.426375:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587353.426380:0:20442:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788587353.426382:0:20442:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8cbf33b0b380) has no exports 00000020:00000080:3.0:1788587353.426387:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344a91 00000020:00000080:3.0:1788587353.426390:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf063ed000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788587353.426718:0:20442:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788587353.426724:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788587353.426729:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788587353.427032:0:20442:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587353.427035:0:20442:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587353.427063:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587353.427070:0:20442:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788587353.427076:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344a83 00000020:00000080:3.0:1788587353.427080:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf063e9000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788587353.427084:0:20442:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788587353.427195:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587353.427200:0:20442:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788587353.427203:0:20442:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8cbf181a3380) has no exports 00000020:00000080:3.0:1788587353.427207:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344a75 00000020:00000080:3.0:1788587353.427211:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf3abbc800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788587353.427666:0:20442:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788587353.427679:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788587353.427682:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1788587353.427686:0:20442:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587353.427688:0:20442:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587353.427711:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587353.427715:0:20442:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788587353.427726:0:20442:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788587353.427822:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344a67 00000020:00000080:3.0:1788587353.427827:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbe03e1c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788587353.427832:0:20442:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788587353.427836:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587353.427839:0:20442:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788587353.427842:0:20442:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8cbf062b8000) has no exports 00000020:00000080:3.0:1788587353.427847:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344a60 00000020:00000080:3.0:1788587353.427849:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf3b87c000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788587353.428097:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf41b13000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788587353.428106:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf063ed000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788587353.428111:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe03e18800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788587353.428117:0:8:0:(genops.c:885:class_export_put()) final put ffff8cbf063eb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788587353.428119:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf063eb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788587353.428122:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788587353.428225:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf063e9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788587353.428230:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3abbc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788587353.428233:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3abbe000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788587353.428237:0:8:0:(genops.c:885:class_export_put()) final put ffff8cbf391e9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788587353.428239:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf391e9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788587353.428241:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788587353.428267:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03e1c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788587353.428270:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b87c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788587353.428998:0:20442:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788587353.429002:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587353.429006:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788587353.429011:0:20442:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587353.429108:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587353.429242:0:20442:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788587353.429269:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587353.429272:0:20442:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788587353.429276:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf3abba000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788587353.429279:0:20442:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3abba000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788587353.429284:0:20442:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788587353.429440:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344a4b 00000020:00000080:3.0:1788587353.429446:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf391e8800/lustre-MDD0001_UUID 00000020:01000000:3.0:1788587353.429450:0:20442:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788587353.429454:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587353.429458:0:20442:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788587353.429461:0:20442:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8cbf3b88b380) has no exports 00000020:00000080:3.0:1788587353.429675:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587353.429679:0:20442:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788587353.429682:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344a52 00000020:00000080:3.0:1788587353.429686:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf391ed000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788587353.429693:0:20442:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe05dae000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788587353.429695:0:20442:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe05dae000 2 00000020:01000004:3.0:1788587353.429698:0:20442:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbe05dae000 from lustre-MDT0001 00000020:00000080:3.0:1788587353.429713:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587353.429716:0:20442:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788587353.429718:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf3abb9000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788587353.429720:0:20442:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3abb9000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788587353.429726:0:20442:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788587353.429892:0:20442:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788587353.429896:0:20442:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788587353.429899:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587353.429903:0:20442:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788587353.429909:0:20442:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8cbf02a82000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788587353.429914:0:20442:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8cbf33b099c0) has exports, disconnecting them 00000020:00080000:3.0:1788587353.429918:0:20442:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8cbf02a82000), last request at 1788587275 00000020:00000080:3.0:1788587353.429922:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344ad0 00000020:00080000:3.0:1788587353.429928:0:20442:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbf02a82000): rc 0 00000020:00000080:3.0:1788587353.429932:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf02a82000/lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788587353.430711:0:20442:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788587353.430716:0:20442:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587353.430719:0:20442:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788587353.430725:0:20442:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587353.430948:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587353.430954:0:20442:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788587353.430959:0:20442:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe05dae000 1 00000020:00000080:3.0:1788587353.430964:0:20442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63449f7 00000020:00000080:3.0:1788587353.430969:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf195f8800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788587353.430996:0:20442:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788587353.431000:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587353.431003:0:20442:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788587353.431006:0:20442:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8cbf33b08000) has no exports 00000020:00000080:2.0:1788587353.431253:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf10959800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788587353.431261:0:8:0:(genops.c:885:class_export_put()) final put ffff8cbe03e1f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788587353.431264:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03e1f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788587353.431269:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788587353.431705:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf391e8800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788587353.431711:0:8:0:(genops.c:885:class_export_put()) final put ffff8cbf3abbc000/lustre-MDD0001_UUID 00000020:00000080:2.0:1788587353.431713:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3abbc000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788587353.431716:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788587353.431925:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf391ed000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788587353.431931:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf02a82000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788587353.431935:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf05220000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788587353.431940:0:8:0:(genops.c:885:class_export_put()) final put ffff8cbf209c0000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788587353.431941:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf209c0000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788587353.431945:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788587353.431968:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf195f8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788587353.443945:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587353.443961:0:20442:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788587353.443966:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbf05398800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788587353.443971:0:20442:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf05398800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788587353.443977:0:20442:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788587353.444114:0:20442:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cbe05da8800 00000020:01000000:1.0:1788587353.444132:0:20442:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788587353.444136:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587353.444141:0:20442:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587353.444144:0:20442:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8cbf41a33380) has no exports 00000100:00100000:1.0:1788587353.444922:0:16443:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8cbf086ae400:16443] 1 exiting: rc = 0 00000100:00100000:1.0:1788587353.445030:0:16442:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8cbf086af400:16442] 0 exiting: rc = 1 00000100:00100000:1.0:1788587353.445089:0:16444:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8cbf37340a00:16444] 2 exiting: rc = 0 00000100:00100000:0.0:1788587353.446150:0:17774:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8cbe05df9a00:17774] 3 exiting: rc = 0 00000100:00100000:1.0:1788587353.446658:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446666:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446672:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446689:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446694:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446699:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446704:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446709:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446713:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446719:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446725:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446735:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446741:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446746:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446751:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446756:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446761:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446766:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446774:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446782:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446789:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446811:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446818:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446824:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446830:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446836:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446842:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446847:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446853:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446858:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446863:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446868:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446874:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446879:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446884:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446889:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446894:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446900:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446914:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446921:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446927:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446933:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446943:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446949:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446953:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446962:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446968:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446973:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446978:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.446995:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447001:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447007:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447012:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447020:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447030:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447038:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447044:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447049:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447054:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447059:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447067:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447072:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447077:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.447082:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.456973:0:16446:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cbf1090b200:16446] 1 exiting: rc = 0 00000100:00100000:3.0:1788587353.457480:0:16445:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cbf2086b800:16445] 0 exiting: rc = 1 00000100:00100000:1.0:1788587353.457662:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457673:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457688:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457694:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457702:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457708:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457724:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457730:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457749:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457755:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457759:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457764:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457768:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457773:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457778:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457783:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457788:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457822:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457829:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457834:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457839:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457844:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457849:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457854:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457859:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457864:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.457869:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459835:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459844:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459850:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459855:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459861:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459866:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459881:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459888:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459893:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459898:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459902:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459907:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459912:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459917:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459922:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459927:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459951:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459956:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459962:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459968:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459973:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459979:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.459995:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460001:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460006:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460011:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460016:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460022:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460028:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460033:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460038:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460044:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460049:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460054:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460058:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460063:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.460069:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587353.465283:0:16447:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8cbf03672c00:16447] 0 exiting: rc = 1 00000100:00100000:3.0:1788587353.473937:0:16448:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8cbf117fea00:16448] 1 exiting: rc = 0 00000100:00100000:1.0:1788587353.474042:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474051:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474065:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474072:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474078:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474083:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474088:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474102:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474116:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474122:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474133:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474139:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474144:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474150:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474168:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474174:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474192:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474204:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474210:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474232:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474240:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474246:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474252:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474258:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474264:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474270:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474276:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474281:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474288:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474293:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474299:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474318:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474324:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474330:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474335:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474340:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474345:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474351:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474357:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474362:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474368:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474374:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474381:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474402:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474409:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474414:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474420:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474426:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474431:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474442:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474447:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474453:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474458:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474464:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474469:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474488:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474494:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474499:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474505:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474511:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474518:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474525:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474532:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.474547:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587353.490638:0:16449:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cbf03673200:16449] 0 exiting: rc = 1 00000100:00100000:3.0:1788587353.492663:0:16450:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cbf03672600:16450] 1 exiting: rc = 0 00000100:00100000:1.0:1788587353.492846:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492853:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492858:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492862:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492867:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492872:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492877:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492882:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492887:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492892:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492897:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492902:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492907:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492913:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492918:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492923:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492928:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492933:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492937:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492942:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492957:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492962:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492967:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492972:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492977:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492981:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.492998:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493003:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493008:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493013:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493019:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493024:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493029:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493034:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493039:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493044:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493050:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493055:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493060:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493066:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493071:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493076:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493081:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493086:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493091:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493096:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493101:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493106:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493111:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493116:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493121:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493125:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493131:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493136:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493141:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493156:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493162:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493168:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493173:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493178:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493202:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493208:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493214:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.493219:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587353.493635:0:16451:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cbf03673e00:16451] 0 exiting: rc = 1 00000100:00100000:0.0:1788587353.495429:0:16452:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cbf03672200:16452] 1 exiting: rc = 0 00000100:00100000:1.0:1788587353.495781:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495790:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495811:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495816:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495821:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495827:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495832:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495837:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495842:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495847:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495853:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495858:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495863:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495868:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495874:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495879:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495884:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495889:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495895:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495900:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495905:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495910:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495915:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495920:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495925:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495930:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495947:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495952:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495957:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495962:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495967:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495972:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495977:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495992:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.495998:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496003:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496008:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496013:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496019:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496024:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496029:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496034:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496039:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496044:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496048:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496053:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496059:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496063:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496068:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496072:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496077:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496081:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496085:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496090:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496095:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496099:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496104:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496108:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496113:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496118:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496123:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496135:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496140:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.496144:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587353.501785:0:16453:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cbf16777600:16453] 0 exiting: rc = 1 00000100:00100000:1.0:1788587353.505011:0:16454:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cbf16776800:16454] 1 exiting: rc = 0 00000100:00100000:1.0:1788587353.507853:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.507863:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.507869:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.507959:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.507964:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.507968:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.507973:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.507978:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.507992:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.507998:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508003:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508008:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508014:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508019:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508028:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508033:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508038:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508044:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508050:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508054:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508059:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508065:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508070:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508075:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508081:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508086:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508092:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508097:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508102:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508107:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508113:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508134:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508139:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508144:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508149:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508153:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508158:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508163:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508169:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508174:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508193:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508313:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508320:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508326:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508340:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508347:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508353:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508359:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508365:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508370:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508376:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508381:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508386:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508392:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508397:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508402:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508408:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508413:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508418:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508423:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508429:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508434:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508439:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.508445:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.509035:0:16457:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8cbf34085e00:16457] 2 exiting: rc = 0 00000100:00100000:0.0:1788587353.510867:0:16456:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8cbf2c813400:16456] 1 exiting: rc = 0 00000100:00100000:3.0:1788587353.510937:0:16455:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8cbf2c812600:16455] 0 exiting: rc = 1 00000100:00100000:1.0:1788587353.511110:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511128:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511134:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511140:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511145:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511151:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511156:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511162:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511167:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511172:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511178:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511330:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511346:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511351:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511358:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511363:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511369:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511375:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511381:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511387:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511392:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511397:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511403:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511408:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511414:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511419:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511426:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511432:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511438:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511444:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511454:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511459:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511467:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511472:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511477:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511497:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511508:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511514:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511520:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511525:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511530:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511535:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511541:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511546:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511552:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511557:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511563:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511569:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511574:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511579:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511584:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511590:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511595:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511601:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511606:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511612:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511617:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511622:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511628:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511636:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511642:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511649:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511656:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587353.511661:0:20442:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788587353.529168:0:20442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587353.529182:0:20442:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788587353.529189:0:20442:0:(genops.c:885:class_export_put()) final put ffff8cbe040c5000/MDS_uuid 00000020:00000080:2.0:1788587353.529194:0:20442:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe040c5000/MDS_uuid for MDS 00000020:01000000:2.0:1788587353.529203:0:20442:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788587353.529352:0:20442:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788587354.219056:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587355.256436:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587355.806741:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587355.806749:0:9072:0:(genops.c:885:class_export_put()) final put ffff8cbe0362c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788587355.808868:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe0362c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788587355.808928:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe03629000 for lustre-OST0001 00010000:00010000:2.0:1788587356.268890:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788587356.279011:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788587356.279021:0:8130:0:(genops.c:885:class_export_put()) final put ffff8cbe03628000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788587356.279599:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe03628000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788587356.279662:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe0362c800 for lustre-OST0000 00000020:01000004:0.0:1788587356.611780:0:20596:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788587356.639199:0:20596:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788587356.639667:0:20596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587356.639683:0:20596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587356.639689:0:20596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587356.639709:0:20596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587356.639731:0:20596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788587356.639737:0:20596:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788587356.639757:0:20596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587356.639760:0:20596:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788587356.639766:0:20596:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788587356.639772:0:20596:0:(import.c:65:import_set_state_nolock()) ffff8cbe044fa000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788587356.639776:0:20596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587356.639778:0:20596:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788587356.639780:0:20596:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788587356.642501:0:20596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587356.642510:0:20596:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788587356.642517:0:20596:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788587356.642541:0:20596:0:(import.c:65:import_set_state_nolock()) ffff8cbf3b26e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788587356.642855:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3471:1875469310060672:0@lo:39:umount.0 00000400:00000100:1.0:1788587356.642932:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310060672 offset 0 length 224: 4 00010000:00010000:0.0:1788587356.643160:0:20285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587356.643176:0:20285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587356.643186:0:20285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3000 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587356.643191:0:20285:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587356.643202:0:20285:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587356.643210:0:20285:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587356.643217:0:20285:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587356.643219:0:20285:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788587356.643222:0:20285:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788587356.643237:0:20285:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe040c6000 00010000:00010000:0.0:1788587356.643241:0:20285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587356.643248:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3000/0x419e1ae1f6344b6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344b71 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587356.643260:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587356.643262:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587356.643264:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587356.715249:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587356.715259:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587356.715261:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587356.715264:0:19211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788587356.715268:0:19211:0:(import.c:65:import_set_state_nolock()) ffff8cbe05877800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587356.715277:0:19211:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 549 00000100:00080000:1.0:1788587356.715282:0:19211:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788587356.715289:0:19211:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cbe05877800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587356.715342:0:19211:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf3bd53480 x1875469310060800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587356.715410:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310060928:0@lo:400:kworker.0 00000400:00000100:1.0:1788587356.715455:0:3473:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310060928 offset 0 length 224: 4 00000100:00100000:2.0:1788587356.715613:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310060800:0@lo:38:kworker.0 00000400:00000100:2.0:1788587356.715635:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310060800 offset 0 length 520: 4 00010000:00010000:1.0:1788587357.291049:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587357.738934:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587357.738945:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587357.738948:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788587357.738951:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788587357.739043:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587357.739073:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469310061056:0@lo:400:kworker.0 00000400:00000100:1.0:1788587357.739127:0:3475:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310061056 offset 0 length 224: 4 00010000:00010000:2.0:1788587358.315988:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587359.339787:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587360.363015:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587361.387126:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587361.770980:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587361.770991:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587361.770994:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788587361.770998:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587361.771253:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587361.771274:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310061184:0@lo:400:kworker.0 00000400:00000100:3.0:1788587361.771328:0:3474:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310061184 offset 0 length 224: 4 00010000:00010000:0.0:1788587362.419378:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587363.435993:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587363.886359:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587353/real 1788587353] req@ffff8cbf10946d80 x1875469310060544/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587363 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587363.886421:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf10946d80 x1875469310060544/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587363 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788587363.886442:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587363.886474:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788587363.886479:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3471:1875469310060544:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1788587363.887235:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788587363.887241:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788587363.887244:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587363.887250:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 550 00000100:00080000:3.0:1788587363.887255:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.114@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788587363.887261:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.114@tcp: import ffff8cbe040c6000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587363.887291:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d56a00 x1875469310061312/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587363.887317:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788587363.887320:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587363.887386:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587363.887398:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310061440:0@lo:400:kworker.0 00000400:00000100:3.0:1788587363.887447:0:3473:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310061440 offset 0 length 224: 4 00000100:00100000:2.0:1788587363.887833:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3471:1875469310061312:0@lo:250:kworker.0 00000400:00000100:2.0:1788587363.887857:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469310061312 offset 0 length 520: 4 00010000:00010000:2.0:1788587364.459470:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587365.484890:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587366.507060:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587366.955017:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587356/real 1788587356] req@ffff8cbf10945f80 x1875469310060672/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587366 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587366.955052:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf10945f80 x1875469310060672/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587366 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587366.955073:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3b26e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788587366.955106:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3471:1875469310060672:0@lo:39:umount.0 00000100:00080000:2.0:1788587366.955270:0:20596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587366.955275:0:20596:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788587366.955280:0:20596:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788587366.956369:0:20596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587366.956384:0:20596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587366.956391:0:20596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587366.956398:0:20596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587366.956477:0:20596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587366.956486:0:20596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587366.956511:0:20596:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587366.956518:0:20596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587366.956523:0:20596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587366.962362:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587366.962377:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587366.962404:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f800 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587366.962409:0:16430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587366.962418:0:16430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587366.962425:0:16430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587366.962431:0:16430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587366.962434:0:16430:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788587366.962448:0:16430:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe040c6000 00010000:00010000:0.0:1788587366.962452:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587366.962458:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f800/0x419e1ae1f6344b40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344b47 expref: -99 pid: 17749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587366.962475:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587366.962479:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587366.962484:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587366.962487:0:16430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587366.962494:0:16430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587366.962506:0:16430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587366.962511:0:16430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788587366.962513:0:16430:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788587366.962518:0:16430:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe040c6000 00010000:00010000:0.0:1788587366.962521:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587366.962528:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587366.962530:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587366.962532:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587366.970693:0:20596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788587366.970708:0:20596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03482c00/0x419e1ae1f6344ea4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344eab expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587366.970735:0:20596:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788587366.970745:0:20596:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788587366.970749:0:20596:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788587366.970778:0:20596:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788587366.970782:0:20596:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788587366.970791:0:20596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587366.970815:0:20596:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788587366.970820:0:20596:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8cbf181a4d40) has no exports 00000020:00080000:2.0:1788587366.970847:0:20596:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8cbf181a4d40) has no exports 00010000:00010000:0.0:1788587366.971429:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788587366.976248:0:20596:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf057f6720 - data ffff8cbf3caced80/ffff8cbe03f1c800 00000020:01000000:3.0:1788587366.976448:0:20596:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf34b48240 - data ffff8cbf3cb7e5e8/ffff8cbe0579b800 00100000:10000000:3.0:1788587366.990925:0:20596:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788587367.029622:0:20596:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344b55 00000020:00000080:2.0:1788587367.029632:0:20596:0:(genops.c:885:class_export_put()) final put ffff8cbe0362f000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788587367.029654:0:20596:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf1095e800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788587367.029658:0:20596:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf1095e800 2 00000020:01000004:2.0:1788587367.029662:0:20596:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbf1095e800 from lustre-OST0000 00000020:00000080:2.0:1788587367.029686:0:20596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587367.029694:0:20596:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788587367.029697:0:20596:0:(genops.c:885:class_export_put()) final put ffff8cbe0362d800/lustre-OST0000_UUID 00000020:00000080:2.0:1788587367.029713:0:20596:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe0362d800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788587367.029719:0:20596:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788587367.029754:0:20596:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788587367.029759:0:20596:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788587367.029762:0:20596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587367.029767:0:20596:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788587367.029774:0:20596:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cbe044fa800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587367.029780:0:20596:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8cbe037a99c0) has exports, disconnecting them 00000020:00080000:2.0:1788587367.029784:0:20596:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cbe044fa800), last request at 1788587286 00000020:00000080:2.0:1788587367.029788:0:20596:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344b7f 00000020:00080000:2.0:1788587367.029829:0:20596:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe044fa800): rc 0 00000020:00000080:2.0:1788587367.029834:0:20596:0:(genops.c:885:class_export_put()) final put ffff8cbe044fa800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788587367.030524:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe0362f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788587367.030542:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe044fa800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788587367.045869:0:20596:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788587367.045879:0:20596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587367.045883:0:20596:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788587367.045901:0:20596:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788587367.046158:0:20596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587367.046168:0:20596:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788587367.046175:0:20596:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788587367.046182:0:20596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587367.046186:0:20596:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788587367.046193:0:20596:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8cbe05872000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788587367.046200:0:20596:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8cbf062bcd40) has exports, disconnecting them 00000020:00080000:0.0:1788587367.046204:0:20596:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8cbe05872000), last request at 1788587286 00000020:00000080:0.0:1788587367.046208:0:20596:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344b94 00000020:00080000:0.0:1788587367.046224:0:20596:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe05872000): rc 0 00000020:00000080:0.0:1788587367.046230:0:20596:0:(genops.c:885:class_export_put()) final put ffff8cbe05872000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788587367.047090:0:19211:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe044fa000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788587367.047100:0:19211:0:(genops.c:885:class_export_put()) final put ffff8cbe044ff800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788587367.047103:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe044ff800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788587367.047109:0:19211:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788587367.047160:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe05872000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788587367.047845:0:20596:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788587367.047850:0:20596:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788587367.047853:0:20596:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788587367.047858:0:20596:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788587367.047878:0:19211:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbf3b26e000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788587367.048214:0:20596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587367.048223:0:20596:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788587367.048227:0:20596:0:(genops.c:885:class_export_put()) final put ffff8cbf3b26c800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788587367.048230:0:20596:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf3b26c800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788587367.048235:0:20596:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788587367.048345:0:20596:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf1095e800 1 00000020:00000080:1.0:1788587367.048351:0:20596:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344b32 00000020:00000080:1.0:1788587367.048357:0:20596:0:(genops.c:885:class_export_put()) final put ffff8cbf10d0b800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788587367.048587:0:20596:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788587367.048598:0:19211:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf10d0b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788587367.048664:0:20596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587367.048670:0:20596:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587367.048674:0:20596:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8cbf062bb380) has no exports 00000020:00000080:1.0:1788587367.065396:0:20596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587367.065413:0:20596:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788587367.065496:0:20596:0:(genops.c:885:class_export_put()) final put ffff8cbf10959000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788587367.065512:0:20596:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf10959000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788587367.065518:0:20596:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788587367.065647:0:20596:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cbf1095d800 00000020:02000400:1.0:1788587367.065681:0:20596:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788587367.538973:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587368.555104:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788587369.003430:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788587369.003441:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587369.003444:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788587369.003447:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587369.004114:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310061568:0@lo:400:kworker.0 00000400:00000100:3.0:1788587369.004181:0:3473:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310061568 offset 0 length 224: 4 00000020:01000004:2.0:1788587369.536644:0:20750:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788587369.547978:0:20750:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788587369.549029:0:20750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587369.549046:0:20750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587369.549054:0:20750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587369.549060:0:20750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587369.549080:0:20750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788587369.549084:0:20750:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788587369.549113:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1788587369.549114:0:20285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587369.549123:0:20285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587369.549125:0:20750:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf3bd53480 x1875469310060800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788587381 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788587369.549143:0:20285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf3200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:1.0:1788587369.549148:0:20285:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587369.549153:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788587369.549161:0:20750:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1788587369.549162:0:20285:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788587369.549168:0:20750:0:(import.c:65:import_set_state_nolock()) ffff8cbe05877800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:00010000:1.0:1788587369.549172:0:20285:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788587369.549174:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587369.549180:0:20750:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf3bd53480 x1875469310060800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788587381 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788587369.549186:0:20285:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587369.549193:0:20285:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:0.0:1788587369.549194:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 10000000:01000000:1.0:1788587369.549197:0:20285:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1788587369.549198:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:1.0:1788587369.549213:0:20285:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe040c6000 00010000:00010000:1.0:1788587369.549217:0:20285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587369.549225:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3200/0x419e1ae1f6344cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344cc8 expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587369.549238:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587369.549240:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587369.549255:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587369.549260:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310060800:0@lo:38:kworker.0 00000100:00080000:0.0:1788587369.550417:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788587369.550430:0:20750:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf3bd50a80 x1875469310060928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587372 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587369.550456:0:20750:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf3bd51c00 x1875469310061056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587373 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587369.550526:0:20750:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf10945180 x1875469310061184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587377 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587369.550546:0:20750:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf35d56d80 x1875469310061440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587379 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587369.550560:0:20750:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf35d54a80 x1875469310061568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587385 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587369.550569:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788587369.550574:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310061440:0@lo:400:kworker.0 00000100:00080000:0.0:1788587369.550575:0:20750:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788587369.550591:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310060928:0@lo:400:kworker.0 00000100:00080000:0.0:1788587369.550599:0:20750:0:(import.c:65:import_set_state_nolock()) ffff8cbe053cb000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788587369.550619:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310061568:0@lo:400:kworker.0 00000100:00100000:2.0:1788587369.550664:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310061184:0@lo:400:kworker.0 00000100:00100000:1.0:1788587369.550707:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469310061056:0@lo:400:kworker.0 00000100:00100000:1.0:1788587369.550730:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3471:1875469310061696:0@lo:39:umount.0 00000400:00000100:1.0:1788587369.550774:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469310061696 offset 0 length 224: 4 00010000:00010000:1.0:1788587369.579217:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587370.603212:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587371.627059:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587372.650987:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587373.676481:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788587374.122916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788587374.122926:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788587374.700460:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587375.727416:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587376.747595:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587377.771135:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587378.794872:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587363/real 1788587363] req@ffff8cbf35d56a00 x1875469310061312/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587378 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587378.794904:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf35d56a00 x1875469310061312/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788587378 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587378.794923:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c6000 MGS: changing import state from CONNECTING to DISCONN 00010000:00010000:0.0:1788587378.794986:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587378.794993:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788587378.794998:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3471:1875469310061312:0@lo:250:kworker.0 00000100:00080000:3.0:1788587378.798642:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788587378.798670:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788587378.798674:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587378.798682:0:36:0:(import.c:545:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 561 00000100:00080000:3.0:1788587378.798688:0:36:0:(import.c:630:import_select_connection()) MGC192.168.203.114@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788587378.798696:0:36:0:(import.c:665:import_select_connection()) MGC192.168.203.114@tcp: import ffff8cbe040c6000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587378.798728:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d54a80 x1875469310061824/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587378.798943:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3471:1875469310061824:0@lo:250:kworker.0 00000400:00000100:1.0:1788587378.798993:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469310061824 offset 0 length 520: 4 00000100:00100000:1.0:1788587379.818949:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587369/real 1788587369] req@ffff8cbf41a2ca80 x1875469310061696/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587379 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587379.818984:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf41a2ca80 x1875469310061696/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788587379 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587379.819445:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe053cb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1788587379.819550:0:16430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587379.821179:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3471:1875469310061696:0@lo:39:umount.0 00000100:00080000:2.0:1788587379.823667:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788587379.823675:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788587379.823682:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788587379.825173:0:20750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587379.825190:0:20750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587379.825198:0:20750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587379.825204:0:20750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587379.825247:0:20750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587379.825255:0:20750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587379.825263:0:20750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587379.825269:0:20750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587379.825274:0:20750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587379.825294:0:20750:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788587379.825298:0:20750:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788587379.825320:0:20750:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788587379.825324:0:20750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788587379.825340:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587379.825346:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788587379.825350:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8cbf181a0000) has no exports 00000020:00080000:2.0:1788587379.825375:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8cbf181a0000) has no exports 00010000:00010000:0.0:1788587379.825428:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587379.825438:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587379.825447:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf3ccf2200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587379.825451:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587379.825462:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587379.825482:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587379.825489:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587379.825492:0:16431:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788587379.825494:0:16431:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788587379.825508:0:16431:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe040c6000 00010000:00010000:0.0:1788587379.825512:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587379.825519:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf2200/0x419e1ae1f6344c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344c9e expref: -99 pid: 18468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587379.825535:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587379.825539:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587379.825545:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483a00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587379.825548:0:16431:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587379.825556:0:16431:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587379.825563:0:16431:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587379.825582:0:16431:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788587379.825584:0:16431:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788587379.825592:0:16431:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788587379.825599:0:16431:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe040c6000 00010000:00010000:0.0:1788587379.825602:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587379.825609:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483a00/0x419e1ae1f6344e96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344e9d expref: -99 pid: 16439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587379.825622:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587379.825624:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587379.825626:0:16431:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587379.825827:0:20285:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788587379.827035:0:20750:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbf057f60c0 - data ffff8cbe0395b5e8/ffff8cbe03f1f400 00000020:01000000:2.0:1788587379.827157:0:20750:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbe05e07480 - data ffff8cbe0395b0d8/ffff8cbe04927c00 00100000:10000000:2.0:1788587379.840130:0:20750:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788587379.880064:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344cac 00000020:00000080:0.0:1788587379.880074:0:20750:0:(genops.c:885:class_export_put()) final put ffff8cbe05aa3800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788587379.880212:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe05aa3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000004:0.0:1788587379.880281:0:20750:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe0587a000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788587379.880286:0:20750:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe0587a000 2 00000020:01000004:0.0:1788587379.880289:0:20750:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbe0587a000 from lustre-OST0001 00000020:00000080:0.0:1788587379.880315:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587379.880323:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788587379.880326:0:20750:0:(genops.c:885:class_export_put()) final put ffff8cbe05875000/lustre-OST0001_UUID 00000020:00000080:0.0:1788587379.880329:0:20750:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe05875000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788587379.880334:0:20750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788587379.880424:0:20750:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 524e146e-34e9-4e2a-818d-ac1a7cb53ea4->MGS 00010000:00010000:0.0:1788587379.880438:0:20750:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26e00/0x419e1ae1f63449fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f6344a05 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587379.880450:0:20750:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26e00/0x419e1ae1f63449fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f6344a05 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587379.880456:0:20750:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788587379.880459:0:20750:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788587379.880462:0:20750:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788587379.880476:0:20750:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe040c6000 00010000:00010000:0.0:1788587379.880491:0:20750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26e00/0x419e1ae1f63449fe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f6344a05 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587379.880509:0:20750:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587379.880677:0:20750:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587379.880682:0:20750:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587379.880684:0:20750:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788587379.880686:0:20750:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788587379.880701:0:20750:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe040c6000 00010000:00010000:0.0:1788587379.880704:0:20750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf3ccf3800/0x419e1ae1f63448ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x419e1ae1f63448f4 expref: -99 pid: 16424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788587379.880720:0:20750:0:(import.c:65:import_set_state_nolock()) ffff8cbe040c6000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788587379.880723:0:20750:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788587379.880726:0:20750:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788587379.880727:0:20750:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788587379.880730:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788587379.880740:0:20750:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbf35d54a80 x1875469310061824/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788587398 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788587379.880823:0:20750:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788587379.880827:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1788587379.880913:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:524e146e-34e9-4e2a-818d-ac1a7cb53ea4:3471:1875469310061824:0@lo:250:kworker.0 10000000:01000000:0.0:1788587379.880974:0:20750:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788587379.880982:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f63448d8 00000020:00000080:0.0:1788587379.880986:0:20750:0:(genops.c:885:class_export_put()) final put ffff8cbe040c4800/524e146e-34e9-4e2a-818d-ac1a7cb53ea4 00000020:01000000:0.0:1788587379.880998:0:20750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.114@tcp (flags='') 00000020:00000080:0.0:1788587379.881003:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587379.881008:0:20750:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.114@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788587379.881011:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8cbf41a34d40) has no exports 10000000:01000000:0.0:1788587379.881037:0:16439:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788587379.881084:0:20750:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.114@tcp: client import never connected 00000100:00080000:0.0:1788587379.881087:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788587379.881100:0:20750:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788587379.881102:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788587379.881104:0:20750:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788587379.881136:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587379.881140:0:20750:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.114@tcp (uuid 524e146e-34e9-4e2a-818d-ac1a7cb53ea4) 00000020:01000000:0.0:1788587379.881145:0:20750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788587379.881148:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587379.881151:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788587379.881156:0:20750:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8cbe05871800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788587379.881161:0:20750:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8cbe052e8000) has exports, disconnecting them 00000020:00080000:0.0:1788587379.881165:0:20750:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8cbe05871800), last request at 1788587299 00000020:00000080:0.0:1788587379.881169:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344cd6 00000020:00080000:0.0:1788587379.881179:0:20750:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe05871800): rc 0 00000020:00000080:0.0:1788587379.881183:0:20750:0:(genops.c:885:class_export_put()) final put ffff8cbe05871800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788587379.881890:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe040c4800/524e146e-34e9-4e2a-818d-ac1a7cb53ea4 for MGC192.168.203.114@tcp 00000020:00000080:3.0:1788587379.881899:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe05871800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788587379.882149:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe040c6000 for MGC192.168.203.114@tcp 00000020:00000080:3.0:1788587379.882157:0:36:0:(genops.c:885:class_export_put()) final put ffff8cbe040c7000/524e146e-34e9-4e2a-818d-ac1a7cb53ea4 00000020:00000080:3.0:1788587379.882159:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe040c7000/524e146e-34e9-4e2a-818d-ac1a7cb53ea4 for MGC192.168.203.114@tcp 00000020:01000000:3.0:1788587379.882163:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.114@tcp (524e146e-34e9-4e2a-818d-ac1a7cb53ea4) 00010000:01000000:1.0:1788587379.883045:0:20750:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788587379.883050:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788587379.883054:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788587379.883060:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788587379.883220:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587379.883228:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788587379.883234:0:20750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788587379.883238:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587379.883242:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788587379.883248:0:20750:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8cbe053cf800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587379.883254:0:20750:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8cbe037acd40) has exports, disconnecting them 00000020:00080000:1.0:1788587379.883258:0:20750:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8cbe053cf800), last request at 1788587299 00000020:00000080:1.0:1788587379.883262:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344ceb 00000020:00080000:1.0:1788587379.883275:0:20750:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe053cf800): rc 0 00000020:00000080:1.0:1788587379.883279:0:20750:0:(genops.c:885:class_export_put()) final put ffff8cbe053cf800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788587379.884032:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe05877800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788587379.884039:0:36:0:(genops.c:885:class_export_put()) final put ffff8cbe05aa1000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788587379.884042:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe05aa1000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788587379.884048:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788587379.884097:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe053cf800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788587379.884849:0:20750:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788587379.884854:0:20750:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788587379.884857:0:20750:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788587379.884862:0:20750:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587379.884882:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe053cb000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788587379.884926:0:16430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788587379.920183:0:16431:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788587379.920329:0:20285:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788587379.920574:0:16425:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cbf10d6dc00:16425] 0 exiting: rc = 1 00000100:00100000:2.0:1788587379.920869:0:16426:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cbf10d6cc00:16426] 1 exiting: rc = 0 00000100:00100000:3.0:1788587379.920913:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.921205:0:16427:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cbf10d6c600:16427] 0 exiting: rc = 1 00000100:00100000:3.0:1788587379.921263:0:16428:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cbf10d6d200:16428] 1 exiting: rc = 0 00000100:00100000:3.0:1788587379.921315:0:18483:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cbe0542a200:18483] 3 exiting: rc = 0 00000100:00100000:3.0:1788587379.921376:0:20286:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8cbf3b359000:20286] 4 exiting: rc = 0 00000100:00100000:3.0:1788587379.922949:0:16429:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cbf10d6da00:16429] 2 exiting: rc = 0 00000100:00100000:3.0:1788587379.923039:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923047:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923053:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923058:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923066:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923072:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923078:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923083:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923089:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923093:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923099:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923104:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923110:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923115:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923121:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923127:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923133:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923138:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923143:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923149:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923154:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923159:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923164:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923170:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923176:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923182:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923187:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923192:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923210:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923215:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923220:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923225:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923230:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923235:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923240:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923246:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923251:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923256:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923261:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923267:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923272:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923277:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923281:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923286:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923291:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923295:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923300:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923306:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923311:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923316:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923321:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923326:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923330:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923335:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923339:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923345:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923350:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923355:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923360:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923365:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923371:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923376:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923384:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587379.923395:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788587379.924314:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587379.924324:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788587379.924330:0:20750:0:(genops.c:885:class_export_put()) final put ffff8cbe044f9800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788587379.924334:0:20750:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe044f9800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788587379.924340:0:20750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788587379.924379:0:20750:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe0587a000 1 00000020:00000080:3.0:1788587379.924385:0:20750:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x419e1ae1f6344c90 00000020:00000080:3.0:1788587379.924392:0:20750:0:(genops.c:885:class_export_put()) final put ffff8cbe05879800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788587379.924403:0:20750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788587379.924414:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe05879800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788587379.924426:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587379.924430:0:20750:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788587379.924434:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8cbf053a99c0) has no exports 00000020:00000080:1.0:1788587379.962450:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587379.962467:0:20750:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788587379.962473:0:20750:0:(genops.c:885:class_export_put()) final put ffff8cbe0587b800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788587379.962477:0:20750:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe0587b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788587379.962488:0:20750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788587379.964544:0:20750:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cbe0587c800 00000020:01000000:1.0:1788587379.964580:0:20750:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788587379.964585:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587379.964590:0:20750:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788587379.964594:0:20750:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8cbf181a19c0) has no exports 00000020:00000080:1.0:1788587379.964617:0:20750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587379.964629:0:20750:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788587379.964642:0:20750:0:(genops.c:885:class_export_put()) final put ffff8cbf10d0d000/OSS_uuid 00000020:00000080:1.0:1788587379.964645:0:20750:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbf10d0d000/OSS_uuid for OSS 00000020:01000000:1.0:1788587379.964651:0:20750:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788587379.964731:0:17750:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8cbf1e92f400:17750] 0 exiting: rc = 1 00000100:00100000:1.0:1788587379.964839:0:18542:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8cbf03644000:18542] 4 exiting: rc = 0 00000100:00080000:3.0:1788587379.964994:0:16438:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788587379.965128:0:17877:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8cbf1e99b400:17877] 3 exiting: rc = 0 00000100:00100000:2.0:1788587379.965220:0:17753:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8cbf3fd61400:17753] 2 exiting: rc = 0 00000100:00100000:3.0:1788587379.968420:0:17751:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8cbf03a7ce00:17751] 1 exiting: rc = 0 00000100:00100000:1.0:1788587379.968846:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968865:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968876:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968887:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968898:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968909:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968918:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968927:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968934:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968940:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968947:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968965:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968972:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968979:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968986:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968992:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.968999:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969004:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969009:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969014:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969019:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969025:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969030:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969035:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969041:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969046:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969052:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969057:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969062:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969069:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969085:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969091:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969095:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969101:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969106:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969111:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969116:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969121:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969126:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969131:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969136:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969141:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969146:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969151:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969156:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969161:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969166:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969172:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969177:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969181:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969186:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969191:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969196:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969202:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969207:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969212:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969218:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969223:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969228:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969234:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969242:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969247:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969253:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.969259:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587379.976952:0:17755:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cbf11598800:17755] 1 exiting: rc = 0 00000100:00100000:2.0:1788587379.977176:0:17754:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cbf19e89200:17754] 0 exiting: rc = 1 00000100:00100000:0.0:1788587379.977268:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977275:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977279:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977285:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977290:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977295:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977300:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977305:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977310:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977315:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977320:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977326:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977332:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977337:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977351:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977356:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977362:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977367:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977372:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977377:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977383:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977388:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977393:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977398:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977403:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977408:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977414:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977419:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977427:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977433:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977438:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977444:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977449:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977454:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977460:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977465:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977470:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977475:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977481:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977486:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977491:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977496:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977511:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977517:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977522:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977528:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977533:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977539:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977544:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977556:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977562:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977567:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977572:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977577:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977582:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977588:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977593:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977599:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977604:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977610:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977615:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977621:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977626:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.977632:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.978788:0:17758:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cbf11b65800:17758] 2 exiting: rc = 0 00000100:00100000:2.0:1788587379.978995:0:17756:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cbf11b65000:17756] 0 exiting: rc = 1 00000100:00100000:2.0:1788587379.979410:0:19306:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8cbe05d95200:19306] 3 exiting: rc = 0 00000100:00100000:0.0:1788587379.982081:0:17757:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cbf11b64e00:17757] 1 exiting: rc = 0 00000100:00100000:1.0:1788587379.982560:0:19307:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff8cbf3712ec00:19307] 4 exiting: rc = 0 00000100:00100000:0.0:1788587379.983486:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983496:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983520:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983536:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983719:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983726:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983733:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983739:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983744:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983750:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983756:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983761:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983766:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983772:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983780:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983787:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983831:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983839:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983855:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983862:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983869:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983876:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983884:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983893:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983904:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983910:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.983916:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984150:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984158:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984163:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984169:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984174:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984179:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984185:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984190:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984196:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984202:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984208:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984213:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984219:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984224:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984229:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984235:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984242:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984247:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984253:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984259:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984265:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984271:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984277:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984283:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984288:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984293:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984307:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984322:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984329:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984335:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984341:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984347:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984353:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984358:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984364:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984377:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587379.984383:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587379.996334:0:17760:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cbf3bc16400:17760] 1 exiting: rc = 0 00000100:00100000:3.0:1788587379.996610:0:17759:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cbf11b64800:17759] 0 exiting: rc = 1 00000100:00100000:1.0:1788587379.996766:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.996775:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.996780:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.996786:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.996791:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.996991:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997000:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997018:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997025:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997034:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997043:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997050:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997058:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997066:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997075:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997084:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997092:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997101:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997109:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997115:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997123:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997182:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997187:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997202:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997210:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997215:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997219:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997225:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997230:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997235:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997240:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997246:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997250:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997254:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997260:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997274:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997279:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997284:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997553:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997560:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997564:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997570:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997574:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997579:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997584:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997589:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997594:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997598:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997602:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997607:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997612:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997616:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997621:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997625:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997630:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997635:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997640:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997645:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997650:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997655:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997660:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997665:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997670:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587379.997681:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587380.001689:0:17761:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cbf2cfcc200:17761] 0 exiting: rc = 1 00000100:00100000:3.0:1788587380.002074:0:17762:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cbf3bc16a00:17762] 1 exiting: rc = 0 00000100:00100000:3.0:1788587380.002146:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002167:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002175:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002181:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002187:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002193:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002199:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002206:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002212:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002217:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002223:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002229:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002234:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002239:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002270:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002275:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.002281:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004641:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004661:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004667:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004673:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004678:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004683:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004689:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004694:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004699:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004726:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004733:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004739:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004744:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004750:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004757:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004763:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004768:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004774:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004780:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004785:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004790:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004838:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004847:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004853:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004858:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004865:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004871:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004877:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004882:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004887:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004893:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004898:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004917:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004935:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004942:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004947:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004952:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004958:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004963:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004979:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004985:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004991:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.004996:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.005007:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.005026:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.005032:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587380.005044:0:20750:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788587380.022740:0:20750:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788587397.706180:0:21474:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788587405.466535:0:21937:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788587405.466540:0:21937:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788587405.466667:0:21937:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbf3b397800 00000020:01000004:3.0:1788587405.466682:0:21937:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788587405.466690:0:21937:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788587405.466703:0:21937:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cbf33b0cd40) 00000020:00000080:3.0:1788587405.466716:0:21937:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788587405.480214:0:21937:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788587405.482368:0:21937:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1788587405.482877:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 209: rc = 0 00100000:10000000:2.0:1788587405.482984:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 209: rc = 0 00100000:10000000:2.0:1788587405.483334:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 209: rc = 0 00100000:10000000:2.0:1788587405.483440:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 209: rc = 0 00100000:10000000:2.0:1788587405.483590:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 209: rc = 0 00100000:10000000:2.0:1788587405.483774:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 209: rc = 0 00100000:10000000:2.0:1788587405.484076:0:21937:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788587405.484148:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 209: rc = 0 00100000:10000000:2.0:1788587405.484390:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 211: rc = 0 00100000:10000000:2.0:1788587405.489516:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 603: rc = 0 00100000:10000000:2.0:1788587405.489702:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 603: rc = 0 00100000:10000000:2.0:1788587405.490225:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 392: rc = 0 00100000:10000000:2.0:1788587405.490783:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 392: rc = 0 00100000:10000000:2.0:1788587405.492067:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587405.492360:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587405.492605:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587405.493020:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 392: rc = 0 00100000:10000000:2.0:1788587405.493252:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587405.493501:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 392: rc = 0 00100000:10000000:2.0:1788587405.493991:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587405.494241:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 392: rc = 0 00100000:10000000:2.0:1788587405.494491:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 392: rc = 0 00100000:10000000:2.0:1788587405.496229:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 392: rc = 0 00100000:10000000:2.0:1788587405.498612:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 773: rc = 0 00100000:10000000:2.0:1788587405.499680:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 773: rc = 0 00100000:10000000:2.0:1788587405.500144:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 773: rc = 0 00100000:10000000:2.0:1788587405.500414:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 773: rc = 0 00100000:10000000:2.0:1788587405.500691:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 773: rc = 0 00100000:10000000:2.0:1788587405.501127:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 773: rc = 0 00100000:10000000:2.0:1788587405.501371:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 773: rc = 0 00100000:10000000:2.0:1788587405.501662:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 773: rc = 0 00100000:10000000:2.0:1788587405.504035:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 773: rc = 0 00100000:10000000:2.0:1788587405.504326:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 773: rc = 0 00100000:10000000:2.0:1788587405.510518:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 773: rc = 0 00100000:10000000:2.0:1788587405.512568:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 773: rc = 0 00100000:10000000:3.0:1788587405.515213:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 773: rc = 0 00100000:10000000:3.0:1788587405.515939:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 773: rc = 0 00100000:10000000:3.0:1788587405.516890:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 773: rc = 0 00100000:10000000:3.0:1788587405.517404:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 773: rc = 0 00100000:10000000:3.0:1788587405.518382:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 773: rc = 0 00100000:10000000:3.0:1788587405.519728:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 773: rc = 0 00100000:10000000:3.0:1788587405.520886:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 773: rc = 0 00100000:10000000:3.0:1788587405.521364:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 773: rc = 0 00100000:10000000:3.0:1788587405.522976:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 773: rc = 0 00100000:10000000:3.0:1788587405.525695:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 773: rc = 0 00100000:10000000:3.0:1788587405.526299:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 773: rc = 0 00100000:10000000:3.0:1788587405.526929:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 773: rc = 0 00100000:10000000:3.0:1788587405.527305:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 773: rc = 0 00100000:10000000:3.0:1788587405.529004:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 773: rc = 0 00100000:10000000:3.0:1788587405.529360:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 773: rc = 0 00100000:10000000:3.0:1788587405.529726:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 773: rc = 0 00100000:10000000:3.0:1788587405.530196:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 773: rc = 0 00100000:10000000:3.0:1788587405.530421:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 773: rc = 0 00100000:10000000:3.0:1788587405.530943:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 773: rc = 0 00100000:10000000:3.0:1788587405.531343:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 773: rc = 0 00100000:10000000:3.0:1788587405.531983:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 770: rc = 0 00100000:10000000:3.0:1788587405.532317:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 770: rc = 0 00100000:10000000:3.0:1788587405.533227:0:21937:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788587405.533384:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 606: rc = 0 00100000:10000000:3.0:1788587405.533723:0:21937:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788587405.533928:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 606: rc = 0 00100000:10000000:3.0:1788587405.534249:0:21937:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788587405.534321:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 606: rc = 0 00100000:10000000:1.0:1788587405.536353:0:21937:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788587405.536440:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 604: rc = 0 00100000:10000000:1.0:1788587405.536680:0:21937:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788587405.537204:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 604: rc = 0 00100000:10000000:1.0:1788587405.537395:0:21937:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788587405.537533:0:21937:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 604: rc = 0 00000020:00000080:1.0:1788587405.538301:0:21937:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788587405.538309:0:21937:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788587405.538322:0:21937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f6345152 00000020:01000004:1.0:1788587405.538330:0:21937:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788587405.538335:0:21937:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788587405.538340:0:21937:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbf3b397800 from MGS 00000020:01000004:1.0:1788587405.538344:0:21937:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788587405.538354:0:21937:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cbe052eb380) 00000020:00000080:1.0:1788587405.538364:0:21937:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788587405.538416:0:21937:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf3b397800 from MGS, refs=2 00080000:01000000:1.0:1788587405.538422:0:21937:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788587405.538427:0:21937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f6345160 00000100:00100000:1.0:1788587405.538686:0:21937:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788587405.538951:0:21937:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788587405.538958:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788587405.539451:0:21937:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788587405.539457:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788587405.540390:0:21937:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587405.540677:0:21937:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788587405.540683:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788587405.541387:0:21937:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788587405.541394:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788587405.541933:0:21937:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788587405.541939:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788587405.542612:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587405.542616:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587405.542617:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587405.542975:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587405.542983:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587405.542985:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587405.546409:0:21937:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788587405.546546:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788587405.567762:0:21937:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788587405.567782:0:21937:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788587405.567786:0:21937:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788587405.569934:0:21946:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788587405.570129:0:21937:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788587405.570219:0:21937:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788587405.571453:0:21937:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788587405.571789:0:21937:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587405.572501:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788587405.572507:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788587405.575372:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788587405.575383:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788587405.575849:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788587405.575856:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788587405.577212:0:21937:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788587405.577231:0:21937:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.114@tcp' 00000020:01000004:2.0:1788587405.577232:0:21937:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788587405.577258:0:21937:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.114@tcp (typ=mgc) 00000020:00000080:2.0:1788587405.577269:0:21937:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.114@tcp (ffff8cbf053ab380) 00000020:00000080:2.0:1788587405.577282:0:21937:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788587405.577349:0:21937:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf0493f000@MGC192.168.203.114@tcp: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788587405.577479:0:21937:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.114@tcp-0 is initialized 00000040:01000000:2.0:1788587405.577485:0:21937:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788587405.577705:0:21951:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788587405.577995:0:21952:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788587405.578058:0:21937:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.114@tcp (uuid f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049) 00000020:00000080:2.0:1788587405.578072:0:21937:0:(genops.c:1385:class_connect()) connect: client f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049, cookie 0x419e1ae1f634516e 00000100:00080000:2.0:1788587405.578080:0:21937:0:(import.c:545:import_select_connection()) MGC192.168.203.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587405.578085:0:21937:0:(import.c:665:import_select_connection()) MGC192.168.203.114@tcp: import ffff8cbf0493f000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587405.578113:0:21937:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf10945180 x1875469310061952/t0(0) o250->MGC192.168.203.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587405.578147:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3471:1875469310061952:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788587405.578201:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788587405.580859:0:21937:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049->MGS 00000020:01000004:3.0:1788587405.580887:0:21937:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788587405.580894:0:21937:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788587405.580908:0:21937:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cbf33b08000) 00000020:00000080:3.0:1788587405.580922:0:21937:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788587405.584762:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310061952 00000100:00100000:1.0:1788587405.584782:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310061952 00000100:00100000:0.0:1788587405.587024:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587405.587042:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3471:x1875469310061952:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788587405.587072:0:21947:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049@0@lo t0 exp 0000000000000000 cur 603 last 0 00000020:00000080:0.0:1788587405.587102:0:21947:0:(genops.c:1385:class_connect()) connect: client f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049, cookie 0x419e1ae1f634517c 00000100:00080000:0.0:1788587405.587222:0:21947:0:(import.c:65:import_set_state_nolock()) ffff8cbe06248000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587405.587305:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+5:3471:x1875469310061952:12345-0@lo:250:mount.lustre.0 Request processed in 264us (9103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587405.587312:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587405.591909:0:3471:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788587405.591924:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.114@tcp: connect to target with instance 0 00000100:00080000:1.0:1788587405.591932:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788587405.591947:0:3471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788587405.591952:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf0493f000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788587405.591955:0:3471:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788587405.591967:0:3471:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788587405.591975:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3471:1875469310061952:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788587405.594789:0:21937:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587405.595004:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788587405.595011:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788587405.596521:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788587405.596529:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788587405.598211:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788587405.598221:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788587405.598877:0:21937:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587405.599058:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788587405.599063:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788587405.599566:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788587405.599574:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788587405.633765:0:21937:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587405.634197:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788587405.634204:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788587405.635575:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788587405.635585:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788587405.636529:0:21937:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587405.636707:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788587405.636713:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788587405.637371:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788587405.637379:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788587405.637990:0:21937:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587405.638284:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788587405.638289:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788587405.639494:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788587405.639504:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788587405.640299:0:21937:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587405.640457:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788587405.640462:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788587405.641342:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788587405.641351:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788587405.657745:0:21937:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587405.658303:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788587405.658310:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788587405.659646:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788587405.659656:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788587405.661159:0:21937:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788587405.661171:0:21937:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788587405.662659:0:21937:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788587405.662684:0:21937:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788587405.662691:0:21937:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788587405.666244:0:21937:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788587405.666298:0:21937:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.114@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788587405.666303:0:21937:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788587405.666305:0:21937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788587405.666306:0:21937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587405.666312:0:21937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587405.666314:0:21937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587405.666315:0:21937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587405.666316:0:21937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788587405.666318:0:21937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788587405.666319:0:21937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587405.666320:0:21937:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587405.666323:0:21937:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788587405.666325:0:21937:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788587405.666326:0:21937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788587405.666327:0:21937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587405.666328:0:21937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587405.666329:0:21937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587405.666330:0:21937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587405.666331:0:21937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788587405.666332:0:21937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788587405.666332:0:21937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587405.666333:0:21937:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587405.666404:0:21937:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788587405.666424:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062080:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788587405.666495:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587405.666696:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587405.666749:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310062080 00000100:00100000:1.0:1788587405.666757:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310062080 00000100:00100000:1.0:1788587405.666979:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587405.666988:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+5:21937:x1875469310062080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788587405.667140:0:21949:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788587405.667143:0:21949:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788587405.667146:0:21949:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788587405.667427:0:21971:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788587405.667940:0:21949:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1788587405.669219:0:21972:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788587405.669225:0:21972:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788587405.669228:0:21972:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788587405.669230:0:21972:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788587405.669268:0:21972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788587405.669541:0:21949:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788587405.669553:0:21949:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788587405.675832:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+5:21937:x1875469310062080:12345-0@lo:253:mount.lustre.0 Request processed in 8836us (9327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587405.675876:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587405.678992:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062080:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788587405.679009:0:21937:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788587405.679012:0:21937:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587405.679182:0:21937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788587405.679183:0:21937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587405.679185:0:21937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587405.679186:0:21937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587405.679187:0:21937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587405.679189:0:21937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788587405.679190:0:21937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788587405.679192:0:21937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587405.679193:0:21937:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788587405.679280:0:21937:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbf3b397800 from lustre-MDT0000 10000000:01000000:2.0:1788587405.679305:0:21937:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788587405.679307:0:21937:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788587405.679311:0:21937:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cbf053ab380 10000000:01000000:2.0:1788587405.679315:0:21937:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788587405.679323:0:21937:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbf053ab380 from 1 10000000:01000000:2.0:1788587405.679326:0:21937:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788587405.679361:0:21937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.679372:0:21937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.679382:0:21937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587405.679401:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587405.679454:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.679493:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01377a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587405.679555:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310062208 00000100:00100000:1.0:1788587405.679561:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310062208 00000100:00100000:1.0:1788587405.679603:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587405.679611:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+5:21937:x1875469310062208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587405.679622:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587405.679646:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03483600/0x419e1ae1f634518a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345183 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.679667:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483600/0x419e1ae1f634518a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345183 expref: 6 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.679678:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03483600/0x419e1ae1f634518a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345183 expref: 6 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.679686:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483600, rc 0) 00000100:00100000:1.0:1788587405.679736:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+6:21937:x1875469310062208:12345-0@lo:101:mount.lustre.0 Request processed in 125us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587405.679742:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587405.679970:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587405.679984:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.679992:0:21937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587405.680180:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587405.680223:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.680293:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01377a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587405.680334:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310062336 00000100:00100000:0.0:1788587405.680339:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310062336 00000100:00100000:0.0:1788587405.680408:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587405.680416:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+6:21937:x1875469310062336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587405.680654:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+6:21937:x1875469310062336:12345-0@lo:501:mount.lustre.0 Request processed in 238us (430us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788587405.680662:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587405.680726:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062336:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788587405.680751:0:21937:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788587405.680770:0:21937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.680780:0:21937:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587405.680787:0:21937:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbf3b397800 10000000:01000000:2.0:1788587405.680791:0:21937:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788587405.680826:0:21937:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cbf3b397800 10000000:01000000:2.0:1788587405.680854:0:21937:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788587405.680858:0:21937:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cbf3b397800 from 1 10000000:01000000:2.0:1788587405.680860:0:21937:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788587405.680879:0:21937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19e00/0x419e1ae1f6345191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.680887:0:21937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19e00/0x419e1ae1f6345191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.680895:0:21937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19e00/0x419e1ae1f6345191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587405.680908:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587405.680932:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.681290:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01377a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587405.681328:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310062464 00000100:00100000:1.0:1788587405.681334:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310062464 00000100:00100000:1.0:1788587405.681365:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587405.681371:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+6:21937:x1875469310062464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587405.681379:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587405.681390:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6345198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345191 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.681406:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6345198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345191 expref: 7 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.681416:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03483a00/0x419e1ae1f6345198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345191 expref: 7 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.681424:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483a00, rc 0) 00000100:00100000:1.0:1788587405.681501:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+7:21937:x1875469310062464:12345-0@lo:101:mount.lustre.0 Request processed in 129us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587405.681507:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587405.681588:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587405.681607:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19e00/0x419e1ae1f6345191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345198 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.681616:0:21937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19e00/0x419e1ae1f6345191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345198 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587405.681629:0:21937:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788587405.681681:0:21937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19e00/0x419e1ae1f6345191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345198 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.681690:0:21937:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19e00/0x419e1ae1f6345191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345198 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587405.681696:0:21937:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788587405.681699:0:21937:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788587405.681704:0:21937:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cbf3b397800 10000000:01000000:2.0:1788587405.681706:0:21937:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788587405.681709:0:21937:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788587405.681711:0:21937:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788587405.681725:0:21937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19400/0x419e1ae1f634519f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.681732:0:21937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19400/0x419e1ae1f634519f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.681740:0:21937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19400/0x419e1ae1f634519f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587405.681752:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587405.681785:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.681818:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01377a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587405.681874:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310062592 00000100:00100000:1.0:1788587405.681878:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310062592 00000100:00100000:1.0:1788587405.681905:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587405.681911:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+7:21937:x1875469310062592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587405.681917:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587405.681926:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03483200/0x419e1ae1f63451a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634519f expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.681940:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483200/0x419e1ae1f63451a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634519f expref: 8 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.681948:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03483200/0x419e1ae1f63451a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634519f expref: 8 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.681966:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483200, rc 0) 00000100:00100000:1.0:1788587405.682003:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+8:21937:x1875469310062592:12345-0@lo:101:mount.lustre.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587405.682008:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587405.682202:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587405.682213:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19400/0x419e1ae1f634519f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63451a6 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.682219:0:21937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19400/0x419e1ae1f634519f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63451a6 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587405.682256:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587405.682280:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.682305:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01377a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587405.682357:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310062720 00000100:00100000:0.0:1788587405.682362:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310062720 00000100:00100000:0.0:1788587405.682393:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587405.682400:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+9:21937:x1875469310062720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587405.682740:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+10:21937:x1875469310062720:12345-0@lo:501:mount.lustre.0 Request processed in 339us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587405.682747:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587405.682834:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587405.682862:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587405.682901:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.682929:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01377a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587405.682979:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310062848 00000100:00100000:0.0:1788587405.682983:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310062848 00000100:00100000:0.0:1788587405.683025:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587405.683110:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+10:21937:x1875469310062848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587405.683339:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+10:21937:x1875469310062848:12345-0@lo:503:mount.lustre.0 Request processed in 307us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587405.683346:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587405.683366:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310062848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587405.683986:0:21973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21973:1875469310062976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587405.684194:0:21973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.684266:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01377840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587405.684309:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310062976 00000100:00100000:0.0:1788587405.684314:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310062976 00000100:00100000:0.0:1788587405.684385:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587405.684394:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+9:21973:x1875469310062976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587405.684670:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+9:21973:x1875469310062976:12345-0@lo:502:llog_process_th.0 Request processed in 277us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587405.684678:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587405.684746:0:21973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21973:1875469310062976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587405.684773:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587405.684783:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587405.684785:0:21973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788587405.684790:0:21973:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788587405.684815:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587405.684830:0:21973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cbf33b099c0) 00000020:00000080:3.0:1788587405.684856:0:21973:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788587405.684863:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788587405.684922:0:21973:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788587405.684928:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f63451b4 00000020:00000080:3.0:1788587405.685139:0:21973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788587405.685143:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587405.685147:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587405.685149:0:21973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788587405.685151:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587405.685156:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587405.685157:0:21973:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788587405.685160:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587405.685167:0:21973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cbf33b0b380) 00000020:00000080:3.0:1788587405.685177:0:21973:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788587405.685181:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788587405.685183:0:21973:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788587405.685186:0:21973:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788587405.685191:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788587405.685244:0:21973:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf3b397800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788587405.685262:0:21973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cbf3b88b380) 00000020:00000080:3.0:1788587405.685271:0:21973:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788587405.685317:0:21973:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788587405.685324:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f63451c9 00000020:00000080:3.0:1788587405.685408:0:21973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788587405.685414:0:21973:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788587405.685419:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x419e1ae1f63451d0 00080000:01000000:3.0:1788587405.685424:0:21973:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788587405.685427:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f63451d7 00010000:00010000:2.0:1788587405.764664:0:21973:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788587405.765222:0:21973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1788587405.765572:0:21973:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788587405.766234:0:21973:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cbf053acd40) 00000020:00000080:2.0:1788587405.766252:0:21973:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788587405.766309:0:21973:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788587405.766316:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f63451e5 00000020:00000080:3.0:1788587405.767826:0:21973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788587405.773120:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x419e1ae1f63451ec 00000020:00000080:3.0:1788587405.779931:0:21973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788587405.779944:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587405.779952:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587405.779954:0:21973:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788587405.779958:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788587405.779960:0:21973:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788587405.779961:0:21973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587405.779963:0:21973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587405.779964:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788587405.779966:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587405.779967:0:21973:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788587405.779970:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587405.779974:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587405.779975:0:21973:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788587405.779979:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788587405.780020:0:21973:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788587405.780206:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587405.780211:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587405.780212:0:21973:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788587405.780215:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587405.780219:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587405.780220:0:21973:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788587405.780223:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788587405.780229:0:21973:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:00000080:3.0:1788587405.780267:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587405.780282:0:21973:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8cbf3b8899c0) 00000020:00000080:3.0:1788587405.780298:0:21973:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788587405.780303:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788587405.780357:0:21973:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788587405.780363:0:21973:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788587405.780370:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f63451fa 00010000:00080000:3.0:1788587405.780401:0:21973:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf10d0c800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788587405.784519:0:21973:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788587405.787085:0:21973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788587405.787101:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788587405.787129:0:21973:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788587405.787160:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f6345201 00000100:00080000:3.0:1788587405.787171:0:21973:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587405.787177:0:21973:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cbf10d0c800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587405.787212:0:21973:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d55500 x1875469310063104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587405.787234:0:21973:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788587405.787286:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587405.787291:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587405.787293:0:21973:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788587405.787296:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788587405.787298:0:21973:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788587405.787300:0:21973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587405.787301:0:21973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587405.787303:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788587405.787305:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587405.787306:0:21973:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788587405.787309:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788587405.787313:0:21973:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788587405.787317:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587405.787319:0:21973:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788587405.787330:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788587405.787334:0:21973:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:3.0:1788587405.787356:0:21973:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788587405.787359:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587405.787371:0:21973:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cbf3b88cd40) 00000020:00000080:3.0:1788587405.787383:0:21973:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788587405.787388:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788587405.787445:0:21973:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788587405.787451:0:21973:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788587405.787455:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f634520f 00010000:00080000:3.0:1788587405.787483:0:21973:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf10d0f800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788587405.787689:0:21973:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788587405.788073:0:21973:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788587405.788118:0:21973:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788587405.789552:0:21973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587405.789626:0:21973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788587405.789708:0:21973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:1.0:1788587405.791328:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310063104:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788587405.791401:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788587405.791726:0:21979:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788587405.791730:0:21979:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788587405.791964:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310063104 00000100:00100000:2.0:1788587405.791972:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310063104 00000100:00100000:2.0:1788587405.792003:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587405.792010:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310063104:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788587405.792029:0:21960:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:1.0:1788587405.795340:0:21973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788587405.795357:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788587405.795396:0:21973:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788587405.795419:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f6345216 00000100:00080000:1.0:1788587405.795429:0:21973:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587405.795436:0:21973:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cbf10d0f800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587405.795469:0:21973:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf3bd52d80 x1875469310063232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587405.795500:0:21973:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788587405.795546:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587405.795549:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587405.795551:0:21973:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788587405.795554:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788587405.795556:0:21973:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788587405.795558:0:21973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587405.795559:0:21973:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587405.795560:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788587405.795562:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587405.795564:0:21973:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788587405.795566:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788587405.795578:0:21973:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788587405.795581:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587405.795583:0:21973:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788587405.795586:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788587405.795590:0:21973:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:1.0:1788587405.795612:0:21973:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788587405.795615:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587405.795626:0:21973:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cbe052e99c0) 00000020:00000080:1.0:1788587405.795652:0:21973:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788587405.795657:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788587405.795708:0:21973:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788587405.795715:0:21973:0:(osd_handler.c:1574:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788587405.795721:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x419e1ae1f6345224 00010000:00080000:1.0:1788587405.795760:0:21973:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf10d7a000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788587405.796339:0:21973:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788587405.796524:0:21973:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788587405.796547:0:21973:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788587405.797985:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310063232:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788587405.798072:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310063232 offset 0 length 520: 4 00000040:00080000:1.0:1788587405.798742:0:21973:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587405.800014:0:21973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788587405.800302:0:21973:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1788587405.801129:0:21981:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788587405.801134:0:21981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788587405.801779:0:21973:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788587405.801832:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788587405.804347:0:21973:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788587405.804378:0:21973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f634522b 00000100:00080000:1.0:1788587405.804400:0:21973:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587405.804406:0:21973:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10d7a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587405.804601:0:21973:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf3bd53b80 x1875469310063360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587405.804640:0:21973:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788587405.804717:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310063360:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788587405.804769:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310063360 offset 0 length 520: 4 00000020:01000000:1.0:1788587405.807290:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587405.807310:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587405.807312:0:21973:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788587405.807316:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587405.807319:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587405.807320:0:21973:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788587405.807323:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788587405.807325:0:21973:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788587405.807328:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587405.807330:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587405.807332:0:21973:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788587405.807334:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587405.807336:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587405.807337:0:21973:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788587405.807340:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788587405.807382:0:21973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21973:1875469310063488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587405.807460:0:21973:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587405.807518:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310063488 00000100:00100000:1.0:1788587405.807525:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310063488 00000100:00100000:1.0:1788587405.807568:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587405.807577:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+9:21973:x1875469310063488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587405.807841:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+9:21973:x1875469310063488:12345-0@lo:502:llog_process_th.0 Request processed in 264us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587405.807849:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587405.807896:0:21973:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf12698900 going to sleep for 11 seconds 00000100:00100000:1.0:1788587405.807917:0:21973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21973:1875469310063488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587405.807942:0:21973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587405.807947:0:21973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587405.807949:0:21973:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788587405.807952:0:21973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788587405.808011:0:21937:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788587405.808746:0:21937:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788587405.808770:0:21937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19400/0x419e1ae1f634519f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63451a6 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.808781:0:21937:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19400/0x419e1ae1f634519f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63451a6 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587405.808790:0:21937:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf3b397800 from 1 10000000:01000000:1.0:1788587405.808818:0:21937:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788587405.808853:0:21937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.808862:0:21937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.808872:0:21937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587405.808889:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310063616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587405.808930:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587405.808960:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf06327a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587405.809157:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310063616 00000100:00100000:0.0:1788587405.809174:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310063616 00000100:00100000:0.0:1788587405.809207:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587405.809215:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+9:21937:x1875469310063616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587405.809226:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587405.809241:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6345239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345232 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.809278:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6345239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345232 expref: 10 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.809289:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6345239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345232 expref: 10 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.809297:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f000, rc 0) 00000100:00100000:0.0:1788587405.809344:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+10:21937:x1875469310063616:12345-0@lo:101:mount.lustre.0 Request processed in 129us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587405.809350:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587405.809691:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310063616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587405.809706:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587405.809715:0:21937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587405.810701:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310063744:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788587405.810771:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587405.810925:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587405.811106:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310063744 00000100:00100000:0.0:1788587405.811114:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310063744 00000100:00100000:0.0:1788587405.811194:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587405.811204:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+10:21937:x1875469310063744:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788587405.811222:0:21947:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788587405.811228:0:21947:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788587405.811311:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+10:21937:x1875469310063744:12345-0@lo:256:mount.lustre.0 Request processed in 108us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587405.811319:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587405.811384:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310063744:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788587405.812302:0:21937:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587405.812324:0:21937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587405.812335:0:21937:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587405.812343:0:21937:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf3b397800 from 1 10000000:01000000:3.0:1788587405.812345:0:21937:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587405.812377:0:21937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587405.812385:0:21937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587405.812393:0:21937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587405.812410:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310063872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587405.812551:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587405.812764:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587405.812970:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310063872 00000100:00100000:1.0:1788587405.812976:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310063872 00000100:00100000:1.0:1788587405.813007:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587405.813015:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+10:21937:x1875469310063872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587405.813025:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587405.813049:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03483800/0x419e1ae1f6345247 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345240 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.813070:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483800/0x419e1ae1f6345247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345240 expref: 11 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.813092:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03483800/0x419e1ae1f6345247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345240 expref: 11 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.813101:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483800, rc 0) 00000100:00100000:1.0:1788587405.813144:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21937:x1875469310063872:12345-0@lo:101:mount.lustre.0 Request processed in 130us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587405.813150:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587405.813407:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310063872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587405.813552:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587405.813561:0:21937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587405.813628:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310064000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587405.813668:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587405.813730:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587405.813762:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310064000 00000100:00100000:1.0:1788587405.813767:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310064000 00000100:00100000:1.0:1788587405.818332:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587405.818350:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf115d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21937:x1875469310064000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587405.818926:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf115d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21937:x1875469310064000:12345-0@lo:501:mount.lustre.0 Request processed in 580us (5254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587405.818935:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587405.819137:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3471:x1875469310063104:12345-0@lo:38:llog_process_th.0 Request processed in 27118us (27727us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788587405.819146:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788587405.819191:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587405.819197:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788587405.819201:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310063104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587405.819365:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310064000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587405.819409:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310064128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587405.819583:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587405.819622:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587405.819749:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310064128 00000100:00100000:2.0:1788587405.819756:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310064128 00000100:00100000:2.0:1788587405.819859:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587405.819868:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf115d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21937:x1875469310064128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587405.820018:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf115d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21937:x1875469310064128:12345-0@lo:503:mount.lustre.0 Request processed in 150us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587405.820025:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587405.820206:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310064128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587405.820646:0:21983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21983:1875469310064256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587405.820686:0:21983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.820717:0:21983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ead80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587405.820765:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310064256 00000100:00100000:3.0:1788587405.820770:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310064256 00000100:00100000:3.0:1788587405.820820:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587405.820827:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21983:x1875469310064256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587405.821028:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21983:x1875469310064256:12345-0@lo:502:llog_process_th.0 Request processed in 201us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587405.821044:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587405.821249:0:21983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21983:1875469310064256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587405.821272:0:21983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587405.821280:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587405.821282:0:21983:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788587405.821289:0:21983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf3b397800 00000020:00000080:2.0:1788587405.821291:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587405.821298:0:21983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587405.821306:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587405.821307:0:21983:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788587405.821310:0:21983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587405.821313:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587405.821314:0:21983:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788587405.821318:0:21983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf3b397800 00000020:00000080:2.0:1788587405.821320:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587405.821374:0:21983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587405.821378:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587405.821379:0:21983:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788587405.821381:0:21983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587405.821384:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587405.821385:0:21983:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788587405.821389:0:21983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf3b397800 00000020:00000080:2.0:1788587405.821390:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788587405.821408:0:21983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587405.821410:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587405.821412:0:21983:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788587405.821414:0:21983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587405.821554:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587405.821555:0:21983:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788587405.821561:0:21983:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf3b397800 00000020:00000080:2.0:1788587405.821563:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788587405.821601:0:21983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21983:1875469310064384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587405.821650:0:21983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.821677:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310064384 00000100:00100000:2.0:1788587405.821681:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310064384 00000100:00100000:2.0:1788587405.821705:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587405.821711:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21983:x1875469310064384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587405.821879:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21983:x1875469310064384:12345-0@lo:502:llog_process_th.0 Request processed in 167us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587405.821895:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587405.821932:0:21983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587405.821945:0:21983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21983:1875469310064384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587405.821964:0:21983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587405.821968:0:21983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587405.821970:0:21983:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788587405.821973:0:21983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788587405.823855:0:21937:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788587405.823886:0:21937:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587405.823906:0:21937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.823919:0:21937:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587405.823958:0:21937:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788587405.823962:0:21937:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbf3b397800 10000000:01000000:2.0:1788587405.823964:0:21937:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbf3b397800 10000000:01000000:2.0:1788587405.823968:0:21937:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788587405.823973:0:21937:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf3b397800 from 1 10000000:01000000:2.0:1788587405.823975:0:21937:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788587405.824005:0:21937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18200/0x419e1ae1f634524e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.824013:0:21937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18200/0x419e1ae1f634524e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.824023:0:21937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18200/0x419e1ae1f634524e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587405.824575:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310064512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587405.824647:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.824690:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1788587405.825159:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310064512 00000100:00100000:0.0:1788587405.825234:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310064512 00000100:00100000:0.0:1788587405.825282:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587405.825290:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21937:x1875469310064512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587405.825303:0:21949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587405.825318:0:21949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499f200/0x419e1ae1f6345255 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634524e expref: -99 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.825340:0:21949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499f200/0x419e1ae1f6345255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634524e expref: 12 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.825350:0:21949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499f200/0x419e1ae1f6345255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634524e expref: 12 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.825359:0:21949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f200, rc 0) 00000100:00100000:0.0:1788587405.825398:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21937:x1875469310064512:12345-0@lo:101:mount.lustre.0 Request processed in 109us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587405.825403:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587405.826289:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310064512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587405.826308:0:21937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18200/0x419e1ae1f634524e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345255 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.826318:0:21937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18200/0x419e1ae1f634524e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345255 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587405.826376:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310064640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587405.826410:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587405.827141:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310064640 00000100:00100000:0.0:1788587405.827148:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310064640 00000100:00100000:0.0:1788587405.827258:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788587405.827268:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21937:x1875469310064640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587405.827545:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1788587405.827780:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21937:x1875469310064640:12345-0@lo:501:mount.lustre.0 Request processed in 514us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587405.827787:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587405.828278:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310064640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587405.828321:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310064768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587405.828366:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.828391:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1788587405.828569:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310064768 00000100:00100000:0.0:1788587405.828575:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310064768 00000100:00100000:0.0:1788587405.828612:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587405.828619:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21937:x1875469310064768:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587405.828779:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21937:x1875469310064768:12345-0@lo:503:mount.lustre.0 Request processed in 159us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587405.828787:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587405.829587:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310064768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587405.840962:0:21985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21985:1875469310064896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587405.841718:0:21985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587405.841829:0:21985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587405.851157:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310064896 00000100:00100000:1.0:1788587405.851244:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310064896 00000100:00100000:1.0:1788587405.851304:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587405.851314:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21985:x1875469310064896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587405.851714:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21985:x1875469310064896:12345-0@lo:502:llog_process_th.0 Request processed in 401us (9996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587405.851722:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788587405.851862:0:21985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21985:1875469310064896:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788587405.851922:0:21985:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788587405.851937:0:21985:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cbf3b888000) 00000020:00000080:3.0:1788587405.851954:0:21985:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788587405.852107:0:21985:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf3b397800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788587405.852112:0:21985:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf3b397800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788587405.852115:0:21985:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf3b397800 4 00010000:00080000:3.0:1788587405.852155:0:21985:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf3bf3a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788587405.859373:0:21985:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788587405.860125:0:21985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788587405.860156:0:21985:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788587405.860173:0:21985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x419e1ae1f6345263 00000100:00080000:3.0:1788587405.860182:0:21985:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587405.860189:0:21985:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cbf3bf3a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587405.860222:0:21985:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d57800 x1875469310065024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587405.860242:0:21985:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788587405.861817:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469310065024:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788587405.861895:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587405.862192:0:21985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21985:1875469310065152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587405.862241:0:21985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587405.862262:0:21985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a9783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587405.862840:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310065024 00000100:00100000:2.0:1788587405.862849:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310065024 00000100:00100000:2.0:1788587405.862889:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587405.862904:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310065024:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587405.862970:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3471:x1875469310065024:12345-0@lo:38:llog_process_th.0 Request processed in 65us (1074us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788587405.862977:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587405.862999:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310065152 00000100:00100000:2.0:1788587405.863002:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310065152 00000100:00100000:2.0:1788587405.863026:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788587405.863043:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21985:x1875469310065152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587405.863374:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21985:x1875469310065152:12345-0@lo:502:llog_process_th.0 Request processed in 331us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587405.863381:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788587405.863570:0:21985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d56d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21985:1875469310065152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587405.863622:0:21985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21985:1875469310065280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587405.863674:0:21985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587405.863773:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587405.863780:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bf3a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587405.863784:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788587405.863787:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469310065024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587405.863863:0:21985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587405.864703:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310065280 00000100:00100000:1.0:1788587405.864710:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310065280 00000100:00100000:1.0:1788587405.864761:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587405.864769:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21985:x1875469310065280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587405.865055:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21985:x1875469310065280:12345-0@lo:502:llog_process_th.0 Request processed in 286us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587405.865065:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587405.866344:0:21985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21985:1875469310065280:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788587405.866383:0:21985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788587405.870581:0:21937:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788587405.870612:0:21937:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788587405.870646:0:21937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18200/0x419e1ae1f634524e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345255 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.870658:0:21937:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18200/0x419e1ae1f634524e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345255 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788587405.870706:0:21937:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788587405.870709:0:21937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788587405.870710:0:21937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587405.870711:0:21937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587405.870712:0:21937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587405.870713:0:21937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587405.870715:0:21937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788587405.870716:0:21937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788587405.870718:0:21937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587405.870719:0:21937:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788587405.870723:0:21937:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788587405.870726:0:21937:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788587405.870727:0:21937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788587405.870733:0:21937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587405.870734:0:21937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587405.870735:0:21937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587405.870736:0:21937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587405.870737:0:21937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788587405.870738:0:21937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788587405.870739:0:21937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587405.870740:0:21937:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788587405.870766:0:21937:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788587405.870786:0:21937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310065408:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788587405.870882:0:21937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587405.870913:0:21937:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf02e10900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587405.871083:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310065408 00000100:00100000:2.0:1788587405.871090:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310065408 00000100:00100000:2.0:1788587405.871133:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587405.871142:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21937:x1875469310065408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788587405.871180:0:21947:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788587405.871194:0:21947:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788587405.923606:0:21947:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788587405.923626:0:21947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788587405.923666:0:21971:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788587405.923671:0:21971:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788587405.923691:0:21971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.923711:0:21971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6345239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345232 expref: 12 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.923720:0:21971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.923760:0:21971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6345239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6345232 expref: 12 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.923773:0:21971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6345239 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6345232 expref: 12 pid: 21947 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587405.923787:0:21971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310065536:0@lo:104: 00000100:00100000:1.0:1788587405.923881:0:21971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587405.923919:0:21971:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03634780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587405.924017:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310065536 00000100:00100000:3.0:1788587405.924025:0:21938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310065536 00000100:00100000:3.0:1788587405.924072:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587405.924509:0:21938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:21971:x1875469310065536:12345-0@lo:104: 00010000:00010000:3.0:1788587405.924524:0:21938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587405.924649:0:21938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587405.924656:0:21938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:21971:x1875469310065536:12345-0@lo:104: Request processed in 153us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587405.924663:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788587405.924771:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587405.924789:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.924826:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:2.0:1788587405.924831:0:21944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587405.924841:0:21944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587405.924856:0:21944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587405.924862:0:21944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587405.924977:0:21944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587405.924990:0:21944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587405.925009:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587405.925016:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03483c00/0x419e1ae1f6345232 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345239 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587405.925032:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587405.925033:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587405.925035:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587405.925058:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310065664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587405.925091:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587405.925179:0:21940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310065664 00000100:00100000:0.0:1788587405.925184:0:21940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310065664 00010000:00010000:0.0:1788587405.925203:0:21940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6345239 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345232 expref: 13 pid: 21947 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587405.925231:0:21940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587405.925238:0:21940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+13:3474:x1875469310065664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587405.925247:0:21940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587405.925252:0:21940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6345239 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345232 expref: 13 pid: 21947 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.925262:0:21940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6345239 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6345232 expref: 13 pid: 21947 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.925277:0:21940:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.925285:0:21940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788587405.925299:0:21940:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001628175s 00010000:00010000:0.0:1788587405.925309:0:21940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.925317:0:21940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.925324:0:21940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.925330:0:21940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.925334:0:21940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587405.925338:0:21940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.925346:0:21940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.925355:0:21940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587405.925364:0:21940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587405.925395:0:21940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+13:3474:x1875469310065664:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587405.925402:0:21940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587405.925545:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310065664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587405.925620:0:21971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499f000/0x419e1ae1f6345239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6345232 expref: 12 pid: 21947 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587405.925642:0:21971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310065536:0@lo:104: 00010000:00010000:1.0:1788587405.925655:0:21971:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.925669:0:21971:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.925675:0:21971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587405.925680:0:21971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03483400/0x419e1ae1f634526a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587405.930348:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21937:x1875469310065408:12345-0@lo:253:mount.lustre.0 Request processed in 59198us (59457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587405.930362:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587405.930535:0:21937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21937:1875469310065408:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788587405.930550:0:21937:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788587405.930553:0:21937:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587405.930555:0:21937:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788587405.930556:0:21937:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587405.930566:0:21937:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587405.930567:0:21937:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587405.930568:0:21937:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587405.930570:0:21937:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788587405.930571:0:21937:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788587405.930573:0:21937:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587405.930574:0:21937:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788587405.930589:0:21937:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788587405.940760:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587405.940994:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587405.941276:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587405.941435:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587405.942428:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587405.942720:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587405.944417:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587405.945571:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587405.946763:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587405.947377:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587405.950939:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587405.951242:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788587405.976379:0:21937:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1788587405.977207:0:21937:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788587405.977598:0:21996:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1788587405.977602:0:21996:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:3.0:1788587405.978665:0:21997:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1788587405.978914:0:21997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788587405.979431:0:21937:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1788587405.980101:0:21998:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8cbf41a2d180 x1875469310065792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587405.980114:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00000040:01000000:1.0:1788587405.982422:0:21937:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788587405.982913:0:21937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788587405.983363:0:21937:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788587405.983373:0:21937:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788587405.984190:0:21937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587405.984423:0:21997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788587405.984609:0:21997:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788587405.990111:0:21937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788587405.991135:0:21937:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788587405.991182:0:21937:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788587405.992395:0:21937:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1788587405.997150:0:21937:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:0.0:1788587406.006348:0:21937:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788587406.043615:0:21937:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788587406.043669:0:21937:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb62541ca3988 00100000:10000000:3.0:1788587406.043677:0:21937:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788587406.045419:0:21937:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788587406.045545:0:21937:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788587406.045560:0:21937:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788587406.045586:0:21937:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788587406.571140:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788587406.700758:0:21952:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788587406.700764:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf3b397800 from 11 10000000:01000000:0.0:1788587406.700769:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587406.700832:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587406.700854:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587406.700874:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587406.700900:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310065920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587406.700972:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587406.701025:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf06327180 going to sleep for 11 seconds 00000100:00100000:0.0:1788587406.701046:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310065920 00000100:00100000:0.0:1788587406.701053:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310065920 00000100:00100000:0.0:1788587406.701100:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587406.701110:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+11:21952:x1875469310065920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587406.701122:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587406.701137:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6345278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345271 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587406.701160:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6345278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345271 expref: 12 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587406.701171:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6345278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345271 expref: 12 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587406.701179:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e600, rc 0) 00000100:00100000:0.0:1788587406.701219:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21952:x1875469310065920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587406.701226:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587406.701523:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310065920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587406.701748:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587406.701768:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587406.701854:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310066048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788587406.701892:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587406.701925:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf06327180 going to sleep for 11 seconds 00000100:00100000:0.0:1788587406.701942:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310066048 00000100:00100000:0.0:1788587406.701946:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310066048 00000100:00100000:0.0:1788587406.701975:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788587406.701984:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21952:x1875469310066048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788587406.701999:0:21947:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788587406.702016:0:21947:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788587406.702020:0:21947:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788587406.702225:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:21952:x1875469310066048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 243us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587406.702233:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788587406.702400:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310066048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788587406.702443:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587406.702450:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587406.702459:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587406.891163:0:21990:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788587406.891172:0:21990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587406.891524:0:21990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788587406.891531:0:21990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788587407.019248:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:3.0:1788587407.595605:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587407.915971:0:21990:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788587407.915982:0:21990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587407.916506:0:21990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788587407.916574:0:21990:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587407.916603:0:21990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1788587408.042935:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:2.0:1788587408.619046:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587409.070571:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:3.0:1788587409.643321:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587410.091917:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00000001:02000400:0.0:1788587410.358145:0:22241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788587410.673347:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587410.988871:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788587410.988878:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788587410.988882:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587410.988890:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 603 00000100:00080000:0.0:1788587410.988897:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587410.988905:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cbf10d0c800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587410.988929:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf41a2f800 x1875469310066304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587410.988945:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587410.988949:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587410.988952:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587410.988956:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587410.988959:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788587410.988961:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788587410.988963:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bf3a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587410.988967:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cbf3bf3a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587410.988978:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf41a2f480 x1875469310066432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587410.991936:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3475:1875469310066176:0@lo:400:kworker.0 00000100:00100000:0.0:1788587410.992009:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587410.992072:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310066304:0@lo:38:kworker.0 00000100:00100000:0.0:1788587410.992752:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587410.992785:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469310066432:0@lo:38:kworker.0 00000100:00100000:0.0:1788587410.992903:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587410.992938:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310066176 00000100:00100000:0.0:1788587410.992946:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310066176 00000100:00100000:0.0:1788587410.992985:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587410.992994:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:3475:x1875469310066176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587410.993043:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:3475:x1875469310066176:12345-0@lo:400:kworker.0 Request processed in 50us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587410.993050:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587410.993591:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310066304 00000100:00100000:1.0:1788587410.993617:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310066304 00000100:00100000:1.0:1788587410.993643:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587410.993649:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3471:x1875469310066304:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788587410.993667:0:21961:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788587410.993713:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3471:x1875469310066304:12345-0@lo:38:kworker.0 Request processed in 64us (961us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788587410.993720:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788587410.993761:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587410.993767:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587410.993770:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310066304:0@lo:38:kworker.0 00000100:00100000:0.0:1788587410.994396:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310066432 00000100:00100000:0.0:1788587410.994403:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310066432 00000100:00100000:0.0:1788587410.994431:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587410.994437:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3471:x1875469310066432:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788587410.994453:0:21957:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 608 last 0 00000100:00100000:1.0:1788587410.994918:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3475:1875469310066176:0@lo:400:kworker.0 00000020:00000080:0.0:1788587410.995034:0:21957:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x419e1ae1f634527f 00000004:00100000:0.0:1788587410.995049:0:21957:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788587410.995328:0:21957:0:(import.c:65:import_set_state_nolock()) ffff8cbf3e05c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587410.995403:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3471:x1875469310066432:12345-0@lo:38:kworker.0 Request processed in 964us (2498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587410.995411:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788587410.995613:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbf41a2f480 x1875469310066432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587410.995629:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788587410.995637:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788587410.995641:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788587410.995644:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3bf3a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788587410.995649:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3471:1875469310066432:0@lo:38:kworker.0 00000100:00100000:1.0:1788587411.116186:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:2.0:1788587411.695157:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587412.141333:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:3.0:1788587412.716318:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587413.163092:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:3.0:1788587413.740630:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587414.186984:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:3.0:1788587414.767219:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587415.084222:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587405/real 1788587405] req@ffff8cbf3bd53b80 x1875469310063360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587415 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587415.084252:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf3bd53b80 x1875469310063360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587415 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587415.084274:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587405/real 1788587405] req@ffff8cbf3bd52d80 x1875469310063232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587415 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587415.084287:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf3bd52d80 x1875469310063232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587415 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788587415.084303:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587415.084318:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587415.084321:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310063360:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788587415.084326:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587415.084332:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587415.084335:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310063232:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788587415.085106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788587415.085111:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788587415.085113:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587415.085120:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 608 00000100:00080000:0.0:1788587415.085127:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788587415.085143:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cbf10d0c800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587415.085166:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf41a2e680 x1875469310066688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587415.085181:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587415.085184:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788587415.085186:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587415.085189:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 603 00000100:00080000:0.0:1788587415.085192:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587415.085195:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cbf10d0f800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587415.085206:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf41a2ca80 x1875469310066816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587415.085215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587415.085218:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788587415.085220:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587415.085223:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 603 00000100:00080000:0.0:1788587415.085225:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587415.085228:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10d7a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587415.085239:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf41a2f100 x1875469310066944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587415.085286:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310067072:0@lo:400:kworker.0 00000100:00100000:0.0:1788587415.085346:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587415.085395:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587415.085402:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3473:1875469310066560:0@lo:400:kworker.0 00000100:00100000:0.0:1788587415.085430:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587415.085495:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310067072 00000100:00100000:0.0:1788587415.085502:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310067072 00000100:00100000:0.0:1788587415.085538:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587415.085545:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310067072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587415.085623:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310067072:12345-0@lo:400:kworker.0 Request processed in 78us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587415.085630:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587415.085651:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310066560 00000100:00100000:0.0:1788587415.085654:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310066560 00000100:00100000:0.0:1788587415.085676:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587415.085682:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:3473:x1875469310066560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587415.085709:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:3473:x1875469310066560:12345-0@lo:400:kworker.0 Request processed in 28us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587415.085715:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587415.085744:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310066688:0@lo:38:kworker.0 00000100:00100000:0.0:1788587415.085767:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587415.085785:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310066816:0@lo:8:kworker.0 00000400:00000100:0.0:1788587415.085844:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310066816 offset 0 length 520: 4 00000100:00100000:0.0:1788587415.085857:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310066944:0@lo:8:kworker.0 00000400:00000100:0.0:1788587415.085873:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310066944 offset 0 length 520: 4 00000100:00100000:0.0:1788587415.086268:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310066688 00000100:00100000:0.0:1788587415.086274:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310066688 00000100:00100000:0.0:1788587415.086300:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587415.086305:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3471:x1875469310066688:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788587415.086322:0:21961:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788587415.086363:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3471:x1875469310066688:12345-0@lo:38:kworker.0 Request processed in 56us (594us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788587415.086375:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587415.086410:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3473:1875469310066560:0@lo:400:kworker.0 00010000:00080000:0.0:1788587415.086423:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbf41a2ed80 x1875469310067072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587415.086433:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310067072:0@lo:400:kworker.0 00000100:00080000:0.0:1788587415.087388:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587415.087396:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788587415.087400:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310066688:0@lo:38:kworker.0 00000100:00100000:1.0:1788587415.210959:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:3.0:1788587415.787199:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587416.235902:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:3.0:1788587416.811946:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788587416.846137:0:22592:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788587416.846141:0:22592:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:3.0:1788587416.846246:0:22592:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbf02a84800 00000020:01000004:3.0:1788587416.846262:0:22592:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788587416.846273:0:22592:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788587416.846286:0:22592:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8cbe044f0000) 00000020:00000080:3.0:1788587416.846305:0:22592:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788587416.869626:0:22592:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788587416.870105:0:22592:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788587416.876930:0:22592:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0001: registered index [0x200000003:0x30:0x0] (8/32) 00100000:10000000:2.0:1788587416.878284:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-MDT0001 under 437: rc = 0 00100000:10000000:2.0:1788587416.879277:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lustre-client under 437: rc = 0 00100000:10000000:2.0:1788587416.879607:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled params under 437: rc = 0 00100000:10000000:2.0:1788587416.881154:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000 under 457: rc = 0 00100000:10000000:2.0:1788587416.882059:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000-MDT0001 under 457: rc = 0 00100000:10000000:2.0:1788587416.882308:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2020000 under 457: rc = 0 00100000:10000000:2.0:1788587416.885976:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000-MDT0001 under 457: rc = 0 00100000:10000000:2.0:1788587416.886271:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000-MDT0001 under 457: rc = 0 00100000:10000000:2.0:1788587416.886518:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000 under 457: rc = 0 00100000:10000000:2.0:1788587416.886781:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x10000-MDT0001 under 457: rc = 0 00100000:10000000:2.0:1788587416.887058:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1020000-MDT0001 under 457: rc = 0 00100000:10000000:2.0:1788587416.887315:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x1010000 under 457: rc = 0 00100000:10000000:2.0:1788587416.887570:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000-MDT0001 under 457: rc = 0 00100000:10000000:2.0:1788587416.887849:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x2010000 under 457: rc = 0 00100000:10000000:2.0:1788587416.892254:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled 0x20000 under 457: rc = 0 00100000:10000000:2.0:1788587416.894162:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_15 under 165: rc = 0 00100000:10000000:2.0:1788587416.895210:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_06 under 165: rc = 0 00100000:10000000:0.0:1788587416.900233:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_04 under 165: rc = 0 00100000:10000000:0.0:1788587416.900693:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_01 under 165: rc = 0 00100000:10000000:1.0:1788587416.905572:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_09 under 165: rc = 0 00100000:10000000:1.0:1788587416.906236:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_03 under 165: rc = 0 00100000:10000000:1.0:1788587416.907438:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_10 under 165: rc = 0 00100000:10000000:1.0:1788587416.908270:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_12 under 165: rc = 0 00100000:10000000:1.0:1788587416.909580:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_14 under 165: rc = 0 00100000:10000000:1.0:1788587416.909989:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_07 under 165: rc = 0 00100000:10000000:1.0:1788587416.910255:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_05 under 165: rc = 0 00100000:10000000:1.0:1788587416.910722:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_08 under 165: rc = 0 00100000:10000000:1.0:1788587416.911271:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_00 under 165: rc = 0 00100000:10000000:1.0:1788587416.911664:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_02 under 165: rc = 0 00100000:10000000:1.0:1788587416.926339:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_11 under 165: rc = 0 00100000:10000000:1.0:1788587416.926647:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_13 under 165: rc = 0 00100000:10000000:1.0:1788587416.926953:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_13 under 165: rc = 0 00100000:10000000:1.0:1788587416.927199:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_11 under 165: rc = 0 00100000:10000000:1.0:1788587416.927441:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_02 under 165: rc = 0 00100000:10000000:1.0:1788587416.927708:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_08 under 165: rc = 0 00100000:10000000:1.0:1788587416.928016:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_00 under 165: rc = 0 00100000:10000000:1.0:1788587416.928263:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_05 under 165: rc = 0 00100000:10000000:1.0:1788587416.931673:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_07 under 165: rc = 0 00100000:10000000:1.0:1788587416.933431:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_14 under 165: rc = 0 00100000:10000000:1.0:1788587416.933726:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_12 under 165: rc = 0 00100000:10000000:1.0:1788587416.934425:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_10 under 165: rc = 0 00100000:10000000:1.0:1788587416.934697:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_03 under 165: rc = 0 00100000:10000000:1.0:1788587416.934972:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_01 under 165: rc = 0 00100000:10000000:1.0:1788587416.935258:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_09 under 165: rc = 0 00100000:10000000:1.0:1788587416.938017:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_namespace_04 under 165: rc = 0 00100000:10000000:2.0:1788587416.948390:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_06 under 165: rc = 0 00100000:10000000:2.0:1788587416.948710:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled lfsck_layout_15 under 165: rc = 0 00100000:10000000:2.0:1788587416.949457:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000400:0x1:0x0] under 644: rc = 0 00100000:10000000:2.0:1788587416.959603:0:22592:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0001: initial OI scrub handled [0x240000401:0x1:0x0] under 644: rc = 0 00000020:00000080:2.0:1788587416.960052:0:22592:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788587416.963783:0:22592:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788587416.963818:0:22592:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f634528d 00000020:01000004:2.0:1788587416.963829:0:22592:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:2.0:1788587416.963854:0:22592:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788587416.963857:0:22592:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788587416.963864:0:22592:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788587416.963897:0:22592:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:2.0:1788587416.963901:0:22592:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788587416.991844:0:22592:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788587416.991894:0:22592:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.114@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788587416.991899:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788587416.991901:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788587416.991902:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587416.991903:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587416.991905:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587416.991906:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587416.991907:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587416.991909:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587416.991910:0:22592:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587416.991914:0:22592:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788587416.991916:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587416.991918:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788587416.991919:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587416.991920:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587416.991921:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587416.991922:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587416.991923:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587416.991924:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587416.991925:0:22592:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587416.991950:0:22592:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788587416.991970:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067200:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788587416.992046:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587416.993321:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03634d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587416.996610:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310067200 00000100:00100000:1.0:1788587416.996627:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310067200 00000100:00100000:1.0:1788587416.996686:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788587416.996710:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:22592:x1875469310067200:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788587416.996761:0:21947:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788587416.996765:0:21947:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788587416.996773:0:21947:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788587417.019184:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:22592:x1875469310067200:12345-0@lo:253:mount.lustre.0 Request processed in 22468us (27128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587417.019199:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587417.019275:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067200:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788587417.019289:0:22592:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788587417.019292:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788587417.019294:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788587417.019295:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587417.019296:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587417.019298:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587417.019299:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587417.019300:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587417.019302:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587417.019303:0:22592:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788587417.019322:0:22592:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbf02a84800 from lustre-MDT0001 10000000:01000000:3.0:1788587417.019349:0:22592:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788587417.019351:0:22592:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788587417.019357:0:22592:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbf053ab380 local copy 00010000:00010000:3.0:1788587417.019370:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587417.020100:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587417.020145:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587417.020187:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf036349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587417.020254:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310067328 00000100:00100000:1.0:1788587417.020262:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310067328 00000100:00100000:1.0:1788587417.020313:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788587417.020323:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:22592:x1875469310067328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587417.020502:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:22592:x1875469310067328:12345-0@lo:501:mount.lustre.0 Request processed in 181us (356us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587417.020509:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788587417.020629:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067328:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788587417.020647:0:22592:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788587417.020860:0:22592:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788587417.020869:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.020879:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587417.020910:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbf02a84800 10000000:01000000:3.0:1788587417.020914:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788587417.020919:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cbf053ab380 10000000:01000000:3.0:1788587417.020921:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788587417.020925:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cbf053ab380 from 1 10000000:01000000:3.0:1788587417.020927:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788587417.020952:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031600/0x419e1ae1f6345294 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.020960:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf00031600/0x419e1ae1f6345294 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.020968:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf00031600/0x419e1ae1f6345294 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587417.020982:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587417.021011:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587417.021038:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf036349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587417.021229:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310067456 00000100:00100000:1.0:1788587417.021235:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310067456 00000100:00100000:1.0:1788587417.021274:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788587417.021283:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+12:22592:x1875469310067456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587417.021292:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587417.021305:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03482e00/0x419e1ae1f634529b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345294 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.021324:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482e00/0x419e1ae1f634529b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345294 expref: 13 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.021335:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03482e00/0x419e1ae1f634529b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345294 expref: 13 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.021343:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482e00, rc 0) 00000100:00100000:1.0:1788587417.021381:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+13:22592:x1875469310067456:12345-0@lo:101:mount.lustre.0 Request processed in 101us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587417.021397:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587417.021578:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587417.021591:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf00031600/0x419e1ae1f6345294 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634529b expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.021600:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf00031600/0x419e1ae1f6345294 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634529b expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587417.021618:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788587417.021638:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031600/0x419e1ae1f6345294 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634529b expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.021655:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf00031600/0x419e1ae1f6345294 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634529b expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587417.021662:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cbf02a84800 10000000:01000000:3.0:1788587417.021665:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788587417.021669:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cbf02a84800 from 1 10000000:01000000:3.0:1788587417.021671:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788587417.021686:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031c00/0x419e1ae1f63452a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.021693:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf00031c00/0x419e1ae1f63452a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.021700:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf00031c00/0x419e1ae1f63452a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587417.021723:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587417.021751:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587417.021933:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf036349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587417.022194:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310067584 00000100:00100000:2.0:1788587417.022200:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310067584 00000100:00100000:3.0:1788587417.022355:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587417.022364:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+13:22592:x1875469310067584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587417.022372:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587417.022384:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf00031a00/0x419e1ae1f63452a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63452a2 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.022400:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf00031a00/0x419e1ae1f63452a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63452a2 expref: 14 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.022425:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf00031a00/0x419e1ae1f63452a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63452a2 expref: 14 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.022432:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf00031a00, rc 0) 00000100:00100000:3.0:1788587417.022476:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+14:22592:x1875469310067584:12345-0@lo:101:mount.lustre.0 Request processed in 113us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.022482:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587417.022552:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587417.022576:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf00031c00/0x419e1ae1f63452a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63452a9 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587417.022585:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf00031c00/0x419e1ae1f63452a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63452a9 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587417.022599:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788587417.022616:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf00031c00/0x419e1ae1f63452a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63452a9 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587417.022625:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf00031c00/0x419e1ae1f63452a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63452a9 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587417.022639:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788587417.022643:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587417.022647:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cbf02a84800 10000000:01000000:0.0:1788587417.022651:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788587417.022654:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788587417.022656:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788587417.022673:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f000/0x419e1ae1f63452b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587417.022680:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f000/0x419e1ae1f63452b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587417.022687:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f000/0x419e1ae1f63452b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587417.022701:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587417.022744:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587417.023052:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf122e7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587417.023128:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310067712 00000100:00100000:1.0:1788587417.023134:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310067712 00000100:00100000:1.0:1788587417.023157:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788587417.023163:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+14:22592:x1875469310067712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587417.023170:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587417.023179:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03483400/0x419e1ae1f63452b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63452b0 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.023194:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483400/0x419e1ae1f63452b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63452b0 expref: 15 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.023202:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03483400/0x419e1ae1f63452b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63452b0 expref: 15 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.023209:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483400, rc 0) 00000100:00100000:1.0:1788587417.023246:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+15:22592:x1875469310067712:12345-0@lo:101:mount.lustre.0 Request processed in 83us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587417.023252:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587417.023621:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587417.023634:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f000/0x419e1ae1f63452b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63452b7 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587417.023642:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f000/0x419e1ae1f63452b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63452b7 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587417.024456:0:22592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1788587417.025314:0:22592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587417.025543:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788587417.025612:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1788587417.025669:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1788587417.025708:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1788587417.025746:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1788587417.025828:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1788587417.025873:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1788587417.025910:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1788587417.025966:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1788587417.026005:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1788587417.026044:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1788587417.026101:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1788587417.026145:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1788587417.026187:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1788587417.026247:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1788587417.026280:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1788587417.026305:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1788587417.026344:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1788587417.026371:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1788587417.026397:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1788587417.026434:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1788587417.026463:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1788587417.026488:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1788587417.026529:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1788587417.027319:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1788587417.027378:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1788587417.027436:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1788587417.027472:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1788587417.027506:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1788587417.027553:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1788587417.027625:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1788587417.027662:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1788587417.027713:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1788587417.028060:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1788587417.028106:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1788587417.028157:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1788587417.028194:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1788587417.028227:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1788587417.028277:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1788587417.028314:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1788587417.028348:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1788587417.028397:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1788587417.028435:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1788587417.028467:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1788587417.028595:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1788587417.028603:0:22592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1788587417.028705:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587417.028824:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587417.028862:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf067ae840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587417.028998:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310067840 00000100:00100000:1.0:1788587417.029006:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310067840 00000100:00100000:1.0:1788587417.029060:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788587417.029069:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3438d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+15:22592:x1875469310067840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587417.029432:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3438d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+15:22592:x1875469310067840:12345-0@lo:501:mount.lustre.0 Request processed in 363us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587417.029441:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587417.029669:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587417.029707:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587417.029762:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587417.029935:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf067ae840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587417.030013:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310067968 00000100:00100000:3.0:1788587417.030019:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310067968 00000100:00100000:3.0:1788587417.030056:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788587417.030063:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3438e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+15:22592:x1875469310067968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587417.030380:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3438e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+15:22592:x1875469310067968:12345-0@lo:503:mount.lustre.0 Request processed in 318us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.030387:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587417.030527:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310067968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788587417.031363:0:22592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587417.031427:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310068096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587417.031474:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587417.031511:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587417.031991:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310068096 00000100:00100000:3.0:1788587417.031998:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310068096 00000100:00100000:3.0:1788587417.032088:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788587417.032098:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3438dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+15:22592:x1875469310068096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587417.032397:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3438dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+15:22592:x1875469310068096:12345-0@lo:502:mount.lustre.0 Request processed in 300us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.032404:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788587417.032508:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310068096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788587417.033032:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788587417.033150:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1788587417.033210:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1788587417.033238:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1788587417.033260:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1788587417.033298:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1788587417.033324:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1788587417.033347:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1788587417.033385:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1788587417.033412:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1788587417.033441:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1788587417.033479:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1788587417.033512:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1788587417.033537:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1788587417.033611:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1788587417.033648:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1788587417.033681:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1788587417.033741:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1788587417.034169:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1788587417.034213:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1788587417.034265:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1788587417.034301:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1788587417.034337:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1788587417.034384:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1788587417.034423:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1788587417.034458:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1788587417.034508:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1788587417.034570:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1788587417.034610:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1788587417.034663:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1788587417.034727:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1788587417.034763:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1788587417.035266:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1788587417.035302:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1788587417.035330:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1788587417.035379:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1788587417.035406:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1788587417.035431:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1788587417.035471:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1788587417.035500:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1788587417.035526:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1788587417.035698:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1788587417.035746:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1788587417.035921:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1788587417.035970:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310068224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587417.036040:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587417.036195:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587417.036268:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310068224 00000100:00100000:3.0:1788587417.036275:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310068224 00000100:00100000:3.0:1788587417.036330:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788587417.036339:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+15:22592:x1875469310068224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587417.036626:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+15:22592:x1875469310068224:12345-0@lo:502:mount.lustre.0 Request processed in 287us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.036639:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587417.037312:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310068224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587417.037507:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1788587417.037520:0:22592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788587417.039215:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587417.039228:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587417.039230:0:22593:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788587417.039236:0:22593:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788587417.039239:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587417.039253:0:22593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8cbe037acd40) 00000020:00000080:0.0:1788587417.039273:0:22593:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788587417.039279:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788587417.039358:0:22593:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788587417.039367:0:22593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f63452c5 00000020:00000080:0.0:1788587417.039650:0:22593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788587417.039656:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587417.039660:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587417.039662:0:22593:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788587417.039665:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587417.039669:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587417.039671:0:22593:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788587417.039674:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587417.039683:0:22593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8cbe037a99c0) 00000020:00000080:0.0:1788587417.039695:0:22593:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788587417.039708:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788587417.039710:0:22593:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788587417.039712:0:22593:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788587417.039892:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788587417.039943:0:22593:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf02a84800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788587417.039957:0:22593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8cbe037ab380) 00000020:00000080:0.0:1788587417.039967:0:22593:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788587417.040030:0:22593:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788587417.040036:0:22593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f63452da 00000020:00000080:0.0:1788587417.040266:0:22593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788587417.040273:0:22593:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788587417.040279:0:22593:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x419e1ae1f63452e1 00080000:01000000:0.0:1788587417.040285:0:22593:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788587417.040288:0:22593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f63452e8 00010000:00010000:1.0:1788587417.103264:0:22593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788587417.103988:0:22593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1788587417.104169:0:22593:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788587417.105139:0:22593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788587417.105152:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587417.105158:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587417.105161:0:22593:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788587417.105165:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587417.105171:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587417.105172:0:22593:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788587417.105175:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788587417.105181:0:22593:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:00000080:3.0:1788587417.105210:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587417.105224:0:22593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8cbe044f4d40) 00000020:00000080:3.0:1788587417.105246:0:22593:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788587417.105252:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788587417.105326:0:22593:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788587417.105332:0:22593:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788587417.105339:0:22593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f63452f6 00010000:00080000:3.0:1788587417.105369:0:22593:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf391ed000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:3.0:1788587417.107111:0:22593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788587417.112490:0:22593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788587417.112506:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788587417.112539:0:22593:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788587417.112575:0:22593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f63452fd 00000100:00080000:2.0:1788587417.112586:0:22593:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587417.112597:0:22593:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8cbf391ed000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587417.112634:0:22593:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf10944380 x1875469310068352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587417.112700:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310068352:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587417.112845:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788587417.112932:0:22593:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788587417.112994:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587417.112999:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587417.113001:0:22593:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788587417.113003:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788587417.113006:0:22593:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788587417.113008:0:22593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587417.113009:0:22593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587417.113010:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788587417.113013:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587417.113014:0:22593:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788587417.113016:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587417.113020:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587417.113022:0:22593:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788587417.113025:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788587417.113057:0:22593:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788587417.113069:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587417.113073:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587417.113074:0:22593:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788587417.113076:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788587417.113078:0:22593:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788587417.113079:0:22593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587417.113081:0:22593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587417.113082:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788587417.113085:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587417.113086:0:22593:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788587417.113088:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788587417.113091:0:22593:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:2.0:1788587417.113094:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587417.113101:0:22593:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788587417.113105:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788587417.113109:0:22593:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:2.0:1788587417.113130:0:22593:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788587417.113133:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788587417.113147:0:22593:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8cbf053a8000) 00000020:00000080:2.0:1788587417.113160:0:22593:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788587417.113165:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788587417.113233:0:22593:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788587417.113240:0:22593:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788587417.113248:0:22593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f634530b 00010000:00080000:2.0:1788587417.113279:0:22593:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe03e1a000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788587417.113487:0:22593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1788587417.113971:0:22593:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788587417.114022:0:22593:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788587417.114916:0:22593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587417.114975:0:22593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788587417.115038:0:22593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:2.0:1788587417.115093:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788587417.115098:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788587417.115102:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587417.115110:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:2.0:1788587417.115114:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788587417.115120:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cbf10d0c800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587417.115151:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf10944000 x1875469310068480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587417.115237:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310068352 00000100:00100000:0.0:1788587417.115246:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310068352 00000100:00100000:0.0:1788587417.115286:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587417.115293:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3471:x1875469310068352:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788587417.115318:0:21961:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 614 last 0 00000020:00000080:0.0:1788587417.115358:0:21961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f6345312 00000004:00100000:0.0:1788587417.115373:0:21961:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788587417.115379:0:21961:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788587417.119493:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310068480:0@lo:38:kworker.0 00000100:00100000:3.0:1788587417.119578:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587417.120217:0:21960:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788587417.120227:0:21960:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:00080000:3.0:1788587417.120499:0:22598:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788587417.120504:0:22598:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1788587417.120625:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587417.120630:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587417.120638:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587417.120641:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587417.120735:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310068608:0@lo:400:kworker.0 00000100:00100000:2.0:1788587417.120819:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587417.120872:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310068608 00000100:00100000:2.0:1788587417.120880:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310068608 00000100:00100000:2.0:1788587417.120925:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587417.120933:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310068608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587417.120984:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310068608:12345-0@lo:400:kworker.0 Request processed in 51us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587417.120990:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788587417.121024:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbf10946d80 x1875469310068608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587417.121037:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310068608:0@lo:400:kworker.0 00000020:00000080:2.0:1788587417.121365:0:22593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788587417.121376:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788587417.121408:0:22593:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788587417.121428:0:22593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f6345319 00000100:00080000:2.0:1788587417.121435:0:22593:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587417.121440:0:22593:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cbe03e1a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587417.121463:0:22593:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf10946d80 x1875469310068736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587417.121479:0:22593:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788587417.121516:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587417.121520:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587417.121527:0:22593:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788587417.121531:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788587417.121534:0:22593:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788587417.121535:0:22593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587417.121537:0:22593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788587417.121538:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788587417.121541:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587417.121542:0:22593:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788587417.121544:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788587417.121548:0:22593:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:2.0:1788587417.121551:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587417.121552:0:22593:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788587417.121568:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788587417.121571:0:22593:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.114@tcp to nid 0x20000c0a8cb72 (192.168.203.114@tcp) 00000020:01000000:2.0:1788587417.121592:0:22593:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788587417.121595:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788587417.121606:0:22593:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8cbf053a99c0) 00000020:00000080:2.0:1788587417.121618:0:22593:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788587417.121623:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788587417.121689:0:22593:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788587417.121695:0:22593:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788587417.121701:0:22593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x419e1ae1f6345327 00010000:00080000:2.0:1788587417.121734:0:22593:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe03e1c000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:2.0:1788587417.121982:0:22593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788587417.122156:0:22593:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788587417.122179:0:22593:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788587417.122675:0:22593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587417.122731:0:22593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788587417.122786:0:22593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00080000:2.0:1788587417.122869:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587417.122873:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587417.122876:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587417.122884:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587417.123014:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310068736:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788587417.123057:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310068736 offset 0 length 520: 4 00000100:00100000:0.0:1788587417.123889:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310068480 00000100:00100000:0.0:1788587417.123897:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310068480 00000040:00080000:1.0:1788587417.124569:0:22601:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788587417.124574:0:22601:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788587417.125383:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587417.125392:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3471:x1875469310068480:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788587417.125489:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3471:x1875469310068480:12345-0@lo:38:kworker.0 Request processed in 95us (5909us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788587417.125496:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587417.125685:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587417.125694:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0c800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587417.125698:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788587417.125701:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310068480:0@lo:38:kworker.0 00000020:00000080:3.0:1788587417.127498:0:22593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788587417.127513:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788587417.127551:0:22593:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788587417.127582:0:22593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f634532e 00000100:00080000:3.0:1788587417.127592:0:22593:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587417.127598:0:22593:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cbe03e1c000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587417.127630:0:22593:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d57100 x1875469310068864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587417.127649:0:22593:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788587417.127703:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587417.127707:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587417.127709:0:22593:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788587417.127712:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587417.127715:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587417.127716:0:22593:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788587417.127720:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788587417.127721:0:22593:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788587417.127723:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587417.127725:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587417.127727:0:22593:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788587417.127729:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587417.127731:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587417.127740:0:22593:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788587417.127745:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788587417.127852:0:22593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587417.127856:0:22593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587417.127858:0:22593:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788587417.127861:0:22593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:0.0:1788587417.127922:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587417.127927:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587417.127931:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587417.127934:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587417.128223:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310068864:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788587417.128287:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310068864 offset 0 length 520: 4 00000020:01000000:2.0:1788587417.128337:0:22592:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788587417.128366:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788587417.128379:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f000/0x419e1ae1f63452b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63452b7 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587417.128391:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f000/0x419e1ae1f63452b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63452b7 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587417.128398:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf02a84800 from 1 10000000:01000000:2.0:1788587417.128401:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788587417.128428:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587417.128437:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587417.128447:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587417.128463:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310068992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587417.128497:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587417.128525:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087f5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587417.129417:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310068992 00000100:00100000:3.0:1788587417.129426:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310068992 00000100:00100000:3.0:1788587417.129469:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788587417.129478:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+15:22592:x1875469310068992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587417.129491:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587417.129505:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f26e00/0x419e1ae1f634533c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345335 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.129527:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f26e00/0x419e1ae1f634533c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345335 expref: 16 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.129537:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f26e00/0x419e1ae1f634533c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345335 expref: 16 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.129545:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26e00, rc 0) 00000100:00100000:3.0:1788587417.129603:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+16:22592:x1875469310068992:12345-0@lo:101:mount.lustre.0 Request processed in 126us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.129609:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788587417.130339:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310068992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587417.130358:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587417.130368:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587417.130984:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069120:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788587417.131037:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587417.131074:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087f5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587417.131267:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310069120 00000100:00100000:3.0:1788587417.131274:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310069120 00000100:00100000:3.0:1788587417.131314:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587417.131322:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+16:22592:x1875469310069120:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788587417.131339:0:21947:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788587417.131358:0:21947:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788587417.131412:0:21947:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788587417.131491:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+16:22592:x1875469310069120:12345-0@lo:256:mount.lustre.0 Request processed in 169us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.131498:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788587417.131586:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069120:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788587417.132304:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788587417.132411:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587417.132422:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587417.132429:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf02a84800 from 1 10000000:01000000:2.0:1788587417.132431:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587417.132459:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587417.132465:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587417.132473:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587417.132501:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587417.132538:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587417.132580:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587417.132940:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310069248 00000100:00100000:1.0:1788587417.132946:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310069248 00000100:00100000:1.0:1788587417.132985:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587417.132993:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+16:22592:x1875469310069248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587417.133003:0:21949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587417.133016:0:21949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf03483c00/0x419e1ae1f634534a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345343 expref: -99 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.133038:0:21949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03483c00/0x419e1ae1f634534a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345343 expref: 17 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.133048:0:21949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf03483c00/0x419e1ae1f634534a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345343 expref: 17 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.133056:0:21949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483c00, rc 0) 00000100:00100000:1.0:1788587417.133093:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:22592:x1875469310069248:12345-0@lo:101:mount.lustre.0 Request processed in 100us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587417.133099:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788587417.133287:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587417.133300:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587417.133309:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587417.133885:0:22592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788587417.134176:0:22592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587417.134406:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788587417.134450:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788587417.134495:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788587417.134542:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788587417.134583:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788587417.134620:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788587417.134651:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788587417.134675:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788587417.134716:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788587417.134748:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788587417.134781:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788587417.134890:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788587417.134899:0:22592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788587417.134963:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587417.135013:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587417.135051:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087f5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587417.135085:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310069376 00000100:00100000:2.0:1788587417.135091:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310069376 00000100:00100000:2.0:1788587417.135130:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788587417.135139:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:22592:x1875469310069376:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587417.135358:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:22592:x1875469310069376:12345-0@lo:501:mount.lustre.0 Request processed in 219us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587417.135366:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000040:00080000:0.0:1788587417.136541:0:21990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788587417.137003:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587417.137064:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587417.137137:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587417.137298:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087ff3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587417.138935:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310069504 00000100:00100000:2.0:1788587417.138947:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310069504 00000100:00100000:2.0:1788587417.139023:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587417.139032:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:22592:x1875469310069504:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587417.139230:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:22592:x1875469310069504:12345-0@lo:503:mount.lustre.0 Request processed in 198us (2092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587417.139238:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587417.139302:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069504:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788587417.142288:0:22592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788587417.142374:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587417.142454:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587417.142491:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf39f82b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587417.143292:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310069632 00000100:00100000:2.0:1788587417.143300:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310069632 00000100:00100000:2.0:1788587417.143346:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587417.143355:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:22592:x1875469310069632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587417.143591:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:22592:x1875469310069632:12345-0@lo:502:mount.lustre.0 Request processed in 236us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587417.143599:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788587417.143664:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587417.143946:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788587417.143995:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788587417.144045:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788587417.144082:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788587417.144131:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788587417.144183:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788587417.144220:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788587417.144254:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788587417.144304:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788587417.144342:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788587417.144376:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788587417.144408:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587417.144452:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587417.144480:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310069760 00000100:00100000:2.0:1788587417.144484:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310069760 00000100:00100000:2.0:1788587417.144514:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587417.144521:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:22592:x1875469310069760:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587417.144669:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:22592:x1875469310069760:12345-0@lo:502:mount.lustre.0 Request processed in 147us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587417.144676:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587417.144721:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf39f82b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587417.144735:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587417.144845:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788587417.144854:0:22592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788587417.147316:0:22604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587417.147329:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587417.147332:0:22604:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788587417.147340:0:22604:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf02a84800 00000020:00000080:0.0:1788587417.147342:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587417.147350:0:22604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587417.147352:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587417.147354:0:22604:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788587417.147356:0:22604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587417.147359:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587417.147360:0:22604:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788587417.147364:0:22604:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf02a84800 00000020:00000080:0.0:1788587417.147365:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587417.147428:0:22604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587417.147433:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587417.147434:0:22604:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788587417.147437:0:22604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587417.147439:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587417.147440:0:22604:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788587417.147443:0:22604:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf02a84800 00000020:00000080:0.0:1788587417.147445:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587417.147463:0:22604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587417.147466:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587417.147467:0:22604:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788587417.147469:0:22604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788587417.147471:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587417.147472:0:22604:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788587417.147476:0:22604:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf02a84800 00000020:00000080:0.0:1788587417.147478:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788587417.147508:0:22604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587417.147511:0:22604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587417.147512:0:22604:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788587417.147524:0:22604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1788587417.148525:0:22592:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788587417.148575:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587417.148627:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.148640:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587417.148699:0:22592:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788587417.148702:0:22592:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbf02a84800 10000000:01000000:1.0:1788587417.148705:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbf02a84800 10000000:01000000:1.0:1788587417.148710:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587417.148715:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf02a84800 from 1 10000000:01000000:1.0:1788587417.148718:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788587417.148757:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482200/0x419e1ae1f6345351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.148766:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03482200/0x419e1ae1f6345351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.148777:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03482200/0x419e1ae1f6345351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587417.148823:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587417.148908:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587417.148945:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1873d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587417.149987:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310069888 00000100:00100000:2.0:1788587417.149999:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310069888 00000100:00100000:2.0:1788587417.150048:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587417.150468:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:22592:x1875469310069888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587417.150485:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587417.150503:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf40c18c00/0x419e1ae1f6345358 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345351 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587417.150532:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf40c18c00/0x419e1ae1f6345358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345351 expref: 18 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587417.150544:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf40c18c00/0x419e1ae1f6345358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345351 expref: 18 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587417.150562:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c18c00, rc 0) 00000100:00100000:2.0:1788587417.152445:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310069888:12345-0@lo:101:mount.lustre.0 Request processed in 2074us (3529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587417.152456:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788587417.152610:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310069888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587417.152634:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03482200/0x419e1ae1f6345351 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345358 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.152646:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482200/0x419e1ae1f6345351 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345358 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587417.154497:0:22592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1788587417.157238:0:22592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587417.157704:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1788587417.157770:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1788587417.157852:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1788587417.160054:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1788587417.160403:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1788587417.160458:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1788587417.160494:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1788587417.160529:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1788587417.160590:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1788587417.160626:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1788587417.160658:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1788587417.160703:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1788587417.160739:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1788587417.160772:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1788587417.160855:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1788587417.160908:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1788587417.160943:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1788587417.162029:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1788587417.162073:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1788587417.162653:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1788587417.162706:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1788587417.162739:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1788587417.162772:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1788587417.163029:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1788587417.163080:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1788587417.165031:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1788587417.165124:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1788587417.165165:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1788587417.165203:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1788587417.165254:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1788587417.165289:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1788587417.165322:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1788587417.165356:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1788587417.165426:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1788587417.165475:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1788587417.165530:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1788587417.165582:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1788587417.165618:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1788587417.165667:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1788587417.165704:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1788587417.165737:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1788587417.165770:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1788587417.165855:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1788587417.165895:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1788587417.165927:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1788587417.165971:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1788587417.166007:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1788587417.166037:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1788587417.166146:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1788587417.166182:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1788587417.166245:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1788587417.166254:0:22592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1788587417.166366:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587417.166433:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587417.166477:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1873d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587417.167996:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310070016 00000100:00100000:3.0:1788587417.168008:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310070016 00000100:00100000:3.0:1788587417.168065:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788587417.168075:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310070016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587417.168354:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310070016:12345-0@lo:501:mount.lustre.0 Request processed in 278us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.168363:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788587417.170276:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587417.170333:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587417.170397:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587417.170429:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf067ae840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587417.170829:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310070144 00000100:00100000:2.0:1788587417.170836:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310070144 00000100:00100000:2.0:1788587417.170880:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587417.170890:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310070144:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587417.171069:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310070144:12345-0@lo:503:mount.lustre.0 Request processed in 180us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587417.171077:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587417.171230:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070144:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587417.171790:0:22592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587417.173300:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587417.173373:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587417.173412:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1873d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587417.173487:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310070272 00000100:00100000:2.0:1788587417.173494:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310070272 00000100:00100000:2.0:1788587417.173529:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788587417.173537:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310070272:12345-0@lo:502:mount.lustre.0 00000100:00080000:1.0:1788587417.174412:0:21961:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587417.174469:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3471:x1875469310068352:12345-0@lo:38:llog_process_th.0 Request processed in 59175us (61623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587417.174478:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587417.174540:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788587417.174549:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788587417.174567:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788587417.174572:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788587417.174574:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf391ed000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788587417.174586:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310068352:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788587417.174643:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310070400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587417.174673:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587417.174710:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310070400 00000100:00100000:1.0:1788587417.174715:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310070400 00000100:00100000:1.0:1788587417.174744:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587417.174752:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3475:x1875469310070400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587417.174780:0:21960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587417.175218:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3475:x1875469310070400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 465us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587417.175226:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587417.175266:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310070400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587417.176535:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310070272:12345-0@lo:502:mount.lustre.0 Request processed in 2994us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587417.176567:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587417.177018:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587417.177292:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1788587417.177363:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1788587417.177396:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1788587417.177445:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1788587417.177482:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1788587417.177523:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1788587417.177568:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1788587417.177604:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1788587417.177650:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1788587417.177685:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1788587417.177750:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1788587417.177967:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1788587417.178005:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1788587417.178040:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1788587417.178089:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1788587417.178124:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1788587417.178158:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1788587417.178206:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1788587417.178240:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1788587417.178267:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1788587417.178311:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1788587417.178344:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1788587417.178372:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1788587417.178414:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1788587417.178448:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1788587417.178480:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1788587417.178545:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1788587417.178596:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1788587417.178627:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1788587417.178675:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1788587417.178710:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1788587417.178740:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1788587417.178787:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1788587417.179096:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1788587417.179147:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1788587417.179201:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1788587417.179238:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1788587417.179269:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1788587417.179315:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1788587417.179348:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1788587417.179382:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1788587417.179414:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1788587417.179478:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1788587417.179514:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1788587417.179547:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1788587417.179612:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1788587417.179650:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1788587417.179684:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1788587417.180564:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587417.180632:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587417.180673:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1873d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587417.180729:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310070528 00000100:00100000:3.0:1788587417.180737:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310070528 00000100:00100000:3.0:1788587417.180787:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587417.180823:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310070528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587417.181018:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310070528:12345-0@lo:502:mount.lustre.0 Request processed in 223us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.181026:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788587417.181199:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587417.181317:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1788587417.181360:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1788587417.181383:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587417.181416:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587417.181433:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1873d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587417.182033:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310070656 00000100:00100000:3.0:1788587417.182039:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310070656 00000100:00100000:3.0:1788587417.182073:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788587417.182082:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310070656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587417.182247:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310070656:12345-0@lo:502:mount.lustre.0 Request processed in 165us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.182255:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788587417.182326:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587417.182417:0:22592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1788587417.182427:0:22592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788587417.187163:0:22609:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788587417.187180:0:22609:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8cbe052ecd40) 00000020:00000080:1.0:1788587417.187204:0:22609:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788587417.187305:0:22609:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf02a84800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788587417.187310:0:22609:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf02a84800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788587417.187312:0:22609:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf02a84800 3 00010000:00080000:1.0:1788587417.187342:0:22609:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf36b00000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788587417.189636:0:22609:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788587417.190095:0:22609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788587417.190132:0:22609:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587417.190148:0:22609:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x419e1ae1f6345366 00000100:00080000:1.0:1788587417.190159:0:22609:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587417.190166:0:22609:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8cbf36b00000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587417.190202:0:22609:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf3bd51180 x1875469310070784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587417.190235:0:22609:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788587417.190260:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587417.190264:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587417.190267:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587417.190270:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788587417.190340:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310070784:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587417.190412:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587417.190631:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310070784 00000100:00100000:1.0:1788587417.190639:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310070784 00000100:00100000:1.0:1788587417.190678:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587417.190685:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3471:x1875469310070784:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788587417.190706:0:21957:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 614 last 0 00000020:00000080:1.0:1788587417.190745:0:21957:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x419e1ae1f634536d 00000004:00100000:1.0:1788587417.190759:0:21957:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788587417.190834:0:21957:0:(import.c:65:import_set_state_nolock()) ffff8cbf36b02000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587417.190886:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3471:x1875469310070784:12345-0@lo:38:llog_process_th.0 Request processed in 199us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587417.190899:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1788587417.191017:0:22609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00010000:00080000:3.0:1788587417.191234:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbf3bd51180 x1875469310070784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587417.191244:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587417.191251:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788587417.191257:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788587417.191262:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788587417.191264:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf36b00000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788587417.191270:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3471:1875469310070784:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788587417.191296:0:22592:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788587417.191321:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788587417.191337:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482200/0x419e1ae1f6345351 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345358 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.191348:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03482200/0x419e1ae1f6345351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345358 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788587417.191391:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788587417.191393:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788587417.191395:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587417.191396:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587417.191398:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587417.191399:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587417.191404:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587417.191406:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587417.191407:0:22592:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587417.191411:0:22592:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788587417.191413:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587417.191415:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788587417.191415:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587417.191416:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587417.191417:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587417.191418:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587417.191419:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788587417.191420:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587417.191421:0:22592:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788587417.191445:0:22592:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788587417.191460:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788587417.191499:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587417.191527:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf08114c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587417.191567:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310070912 00000100:00100000:3.0:1788587417.191571:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310070912 00000100:00100000:3.0:1788587417.191605:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788587417.191611:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:22592:x1875469310070912:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788587417.191631:0:21949:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788587417.191643:0:21949:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788587417.233755:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788587417.233958:0:21949:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788587417.233967:0:21949:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788587417.234034:0:21971:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788587417.234039:0:21971:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788587417.234059:0:21971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.234078:0:21971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6345278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345271 expref: 18 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.234086:0:21971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f26e00/0x419e1ae1f634533c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345335 expref: 18 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.234094:0:21971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.234131:0:21971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f26e00/0x419e1ae1f634533c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6345335 expref: 18 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.234146:0:21971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f26e00/0x419e1ae1f634533c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6345335 expref: 18 pid: 21948 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587417.234161:0:21971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310071040:0@lo:104: 00000100:00100000:1.0:1788587417.234220:0:21971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587417.234303:0:21971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6345278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6345271 expref: 18 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587417.234312:0:21971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6345278 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6345271 expref: 18 pid: 21948 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587417.234334:0:21971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310071168:0@lo:104: 00000100:00100000:1.0:1788587417.234358:0:21971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587417.235238:0:21971:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf39f82e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587417.235279:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310071040 00000100:00100000:3.0:1788587417.235286:0:21938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310071040 00000100:00100000:3.0:1788587417.235321:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310071168 00000100:00100000:3.0:1788587417.235324:0:21938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310071168 00000100:00100000:3.0:1788587417.235338:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587417.235345:0:21938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+4:21971:x1875469310071040:12345-0@lo:104: 00010000:00010000:3.0:1788587417.235358:0:21938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235474:0:21938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587417.235481:0:21938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+4:21971:x1875469310071040:12345-0@lo:104: Request processed in 136us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.235488:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587417.235505:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587417.235512:0:21938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:21971:x1875469310071168:12345-0@lo:104: 00010000:00010000:3.0:1788587417.235519:0:21938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235562:0:21938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788587417.235568:0:21938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:21971:x1875469310071168:12345-0@lo:104: Request processed in 57us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.235574:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788587417.235591:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587417.235597:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235605:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19000 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587417.235609:0:21944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235618:0:21944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587417.235625:0:21944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587417.235631:0:21944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587417.235668:0:21944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235674:0:21944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587417.235693:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235699:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19000/0x419e1ae1f6345335 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634533c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235711:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587417.235725:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235732:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fa00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587417.235735:0:21944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235741:0:21944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587417.235748:0:21944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587417.235754:0:21944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587417.235766:0:21944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235772:0:21944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587417.235779:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235811:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fa00/0x419e1ae1f6345271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345278 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.235825:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587417.235827:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587417.235829:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587417.235835:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587417.235853:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310071296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587417.235888:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587417.235918:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587417.235924:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310071424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587417.235945:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587417.235988:0:21940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310071296 00000100:00100000:3.0:1788587417.235993:0:21940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310071296 00010000:00010000:3.0:1788587417.236013:0:21940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f26e00/0x419e1ae1f634533c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345335 expref: 19 pid: 21948 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587417.236034:0:21940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310071424 00000100:00100000:3.0:1788587417.236037:0:21940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310071424 00010000:00010000:3.0:1788587417.236048:0:21940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6345278 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345271 expref: 20 pid: 21948 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587417.236061:0:21940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587417.236067:0:21940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:3472:x1875469310071296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587417.236077:0:21940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587417.236082:0:21940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f26e00/0x419e1ae1f634533c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345335 expref: 20 pid: 21948 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236103:0:21940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f26e00/0x419e1ae1f634533c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6345335 expref: 20 pid: 21948 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236119:0:21940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587417.236148:0:21940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:3472:x1875469310071296:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.236155:0:21940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587417.236169:0:21940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587417.236175:0:21940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:3472:x1875469310071424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587417.236183:0:21940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587417.236187:0:21940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6345278 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345271 expref: 19 pid: 21948 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236196:0:21940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6345278 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6345271 expref: 19 pid: 21948 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236207:0:21940:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236215:0:21940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788587417.236228:0:21940:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002189656s 00010000:00010000:3.0:1788587417.236233:0:21940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236239:0:21940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236255:0:21940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236261:0:21940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236266:0:21940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587417.236270:0:21940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236278:0:21940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236286:0:21940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587417.236294:0:21940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587417.236317:0:21940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:3472:x1875469310071424:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.236323:0:21940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587417.236360:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310071424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587417.236369:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310071296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587417.236580:0:21971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f26e00/0x419e1ae1f634533c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6345335 expref: 18 pid: 21948 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587417.236601:0:21971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310071040:0@lo:104: 00010000:00010000:0.0:1788587417.236613:0:21971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499e600/0x419e1ae1f6345278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6345271 expref: 17 pid: 21948 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587417.236622:0:21971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310071168:0@lo:104: 00010000:00010000:0.0:1788587417.236638:0:21971:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587417.236647:0:21971:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587417.236652:0:21971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587417.236657:0:21971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03482a00/0x419e1ae1f6345374 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587417.243574:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+16:22592:x1875469310070912:12345-0@lo:253:mount.lustre.0 Request processed in 51955us (52066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587417.243589:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587417.248080:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:22592:1875469310070912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788587417.248098:0:22592:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788587417.248101:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587417.248103:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788587417.248104:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587417.248105:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587417.248106:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587417.248108:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587417.248109:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788587417.248123:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587417.248125:0:22592:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788587417.248143:0:22592:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788587417.249098:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587417.249273:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587417.249536:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587417.249685:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587417.250198:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587417.250360:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587417.251359:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587417.251516:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587417.252198:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587417.252367:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587417.252644:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587417.258150:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000100:00100000:3.0:1788587417.259010:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00000040:01000000:1.0:1788587417.261155:0:22592:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788587417.261421:0:22616:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788587417.261426:0:22616:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788587417.261499:0:22617:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788587417.261583:0:22617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587417.263931:0:22617:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788587417.264005:0:22617:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788587417.264412:0:22592:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788587417.269024:0:22618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22618:1875469310071552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788587417.269102:0:22618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587417.269145:0:22618:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6ab40 going to sleep for 11 seconds 00000040:01000000:1.0:1788587417.269659:0:22592:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788587417.269963:0:22592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788587417.270385:0:22592:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788587417.270395:0:22592:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788587417.270539:0:22592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587417.271913:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310071552 00000100:00100000:0.0:1788587417.271927:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310071552 00000100:00100000:0.0:1788587417.271990:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587417.272000:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22618:x1875469310071552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788587417.272104:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:22618:x1875469310071552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 105us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587417.272111:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587417.272211:0:22618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22618:1875469310071552:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788587417.272246:0:22618:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788587417.272283:0:22618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22618:1875469310071680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788587417.272319:0:22618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587417.272349:0:22618:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587417.272390:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310071680 00000100:00100000:0.0:1788587417.272394:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310071680 00000100:00100000:0.0:1788587417.272415:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587417.272420:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:22618:x1875469310071680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788587417.272549:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10944a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:22618:x1875469310071680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 127us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587417.272565:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587417.272623:0:22618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22618:1875469310071680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788587417.272674:0:22618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:22618:1875469310071808:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788587417.272699:0:22618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587417.272741:0:21966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310071808 00000100:00100000:2.0:1788587417.272745:0:21966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310071808 00000100:00100000:2.0:1788587417.272922:0:21966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587417.272930:0:21966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22618:x1875469310071808:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788587417.272964:0:21966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:22618:x1875469310071808:12345-0@lo:900:lod0001_rec0000.0 Request processed in 36us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587417.272971:0:21966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587417.272988:0:22618:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6ad80 going to sleep for 11 seconds 00010000:00080000:2.0:1788587417.273000:0:22618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbf10945c00 x1875469310071808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587433 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587417.273027:0:22618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:22618:1875469310071808:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788587417.273061:0:22618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22618:1875469310071936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788587417.273083:0:22618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587417.273103:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310071936 00000100:00100000:2.0:1788587417.273106:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310071936 00000100:00100000:2.0:1788587417.273137:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587417.273144:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22618:x1875469310071936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788587417.273207:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:22618:x1875469310071936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 63us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587417.273214:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587417.273229:0:22618:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587417.273239:0:22618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:22618:1875469310071936:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788587417.273272:0:22618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587417.274151:0:22592:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788587417.274704:0:22592:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788587417.276232:0:22592:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788587417.276529:0:22592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587417.277632:0:22618:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788587417.277697:0:22618:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788587417.277702:0:22618:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:1.0:1788587417.278538:0:22592:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x31:0x0] (8/8/4) registered 00000001:00000004:3.0:1788587417.284269:0:22592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788587417.317976:0:22592:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788587417.318012:0:22592:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb62541c0b988 00100000:10000000:1.0:1788587417.318020:0:22592:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788587417.319050:0:22592:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788587417.319090:0:22592:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788587417.319106:0:22592:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788587417.319124:0:22592:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00010000:00010000:3.0:1788587417.838252:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587418.223630:0:22612:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788587418.285277:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:3.0:1788587418.866358:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788587419.118903:0:21952:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788587419.118911:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf02a84800 from 12 10000000:01000000:0.0:1788587419.118924:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587419.118968:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587419.119418:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587419.119432:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587419.119459:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310072064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587419.119527:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587419.119581:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310072064 00000100:00100000:0.0:1788587419.119588:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587419.119590:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310072064 00000100:00100000:3.0:1788587419.119646:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788587419.119655:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+16:21952:x1875469310072064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587419.119668:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587419.119683:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27c00/0x419e1ae1f6345382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634537b expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587419.119708:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27c00/0x419e1ae1f6345382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634537b expref: 17 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587419.119720:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27c00/0x419e1ae1f6345382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634537b expref: 17 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587419.119730:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27c00, rc 0) 00000100:00100000:3.0:1788587419.119925:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:21952:x1875469310072064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 271us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587419.119944:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788587419.122388:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310072064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587419.122417:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587419.122429:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587419.125111:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310072192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788587419.125183:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587419.125293:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587419.129902:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310072192 00000100:00100000:2.0:1788587419.129918:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310072192 00000100:00100000:0.0:1788587419.130841:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788587419.132991:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:21952:x1875469310072192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788587419.133023:0:21949:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788587419.133038:0:21949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788587419.133042:0:21949:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788587419.133181:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:21952:x1875469310072192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2329us (7996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587419.133192:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788587419.138285:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310072192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788587419.138456:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788587419.138467:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587419.138478:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587419.138488:0:21952:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788587419.138491:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf3b397800 from 12 10000000:01000000:2.0:1788587419.138494:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788587419.138527:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587419.138535:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587419.138556:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587419.138577:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310072320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587419.138631:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587419.138714:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587419.138758:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310072320 00000100:00100000:3.0:1788587419.138765:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310072320 00000100:00100000:0.0:1788587419.139103:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788587419.139114:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:21952:x1875469310072320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587419.139127:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587419.139138:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6345390 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345389 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587419.139159:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6345390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345389 expref: 18 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587419.139176:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6345390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345389 expref: 18 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587419.139184:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499ec00, rc 0) 00000100:00100000:0.0:1788587419.139221:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:21952:x1875469310072320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587419.139227:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788587419.139263:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310072320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587419.139275:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587419.139283:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587419.139323:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310072448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788587419.139348:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587419.139367:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587419.139378:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310072448 00000100:00100000:0.0:1788587419.139381:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310072448 00000100:00100000:0.0:1788587419.139402:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788587419.139407:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:21952:x1875469310072448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788587419.139418:0:21948:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788587419.139431:0:21948:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788587419.139434:0:21948:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788587419.139501:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:21952:x1875469310072448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 82us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587419.139515:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788587419.139550:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310072448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788587419.139582:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587419.139587:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587419.139595:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587419.243475:0:22612:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788587419.306881:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:1.0:1788587419.891646:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587420.335391:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00010000:00010000:3.0:1788587420.907945:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587421.356349:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 0 seconds 00000001:02000400:0.0:1788587421.539325:0:22861:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788587421.930904:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587422.256139:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788587422.256147:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788587422.256151:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0c800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587422.256163:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8cbf10d0c800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587422.256186:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf10944e00 x1875469310072704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587422.256215:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587422.256218:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587422.256221:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587422.256224:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587422.256250:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587422.256253:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587422.256255:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587422.256258:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587422.256281:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469310072832:0@lo:400:kworker.0 00000100:00100000:2.0:1788587422.256338:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587422.256371:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587422.256377:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3475:1875469310072576:0@lo:400:kworker.0 00000100:00100000:2.0:1788587422.256403:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587422.256449:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310072960:0@lo:400:kworker.0 00000100:00100000:2.0:1788587422.256475:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587422.256492:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587422.256496:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310073088:0@lo:400:kworker.0 00000100:00100000:2.0:1788587422.256514:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587422.256555:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310072832 00000100:00100000:2.0:1788587422.256561:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310072832 00000100:00100000:2.0:1788587422.256596:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310073088 00000100:00100000:2.0:1788587422.256599:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310073088 00000100:00100000:2.0:1788587422.256610:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587422.256624:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469310072832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587422.256672:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3475:x1875469310072832:12345-0@lo:400:kworker.0 Request processed in 49us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587422.256679:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587422.256708:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587422.256714:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310073088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587422.256745:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310073088:12345-0@lo:400:kworker.0 Request processed in 32us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587422.256928:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587422.256947:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310072576 00000100:00100000:2.0:1788587422.256951:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310072576 00000100:00100000:2.0:1788587422.256976:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788587422.256983:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:3475:x1875469310072576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587422.257014:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:3475:x1875469310072576:12345-0@lo:400:kworker.0 Request processed in 32us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587422.257020:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788587422.257048:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310072960 00000100:00100000:2.0:1788587422.257051:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310072960 00000100:00100000:2.0:1788587422.257072:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587422.257078:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310072960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587422.257109:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310072960:12345-0@lo:400:kworker.0 Request processed in 31us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587422.257114:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587422.257145:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310072704:0@lo:38:kworker.0 00000100:00100000:2.0:1788587422.257172:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587422.257200:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310072704 00000100:00100000:2.0:1788587422.257209:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310072704 00000100:00100000:2.0:1788587422.257228:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587422.257232:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3471:x1875469310072704:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788587422.257252:0:22600:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:2.0:1788587422.257283:0:22600:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f6345397 00000004:00100000:2.0:1788587422.257299:0:22600:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788587422.257304:0:22600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788587422.257721:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310073216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587422.257767:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587422.257860:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310073216 00000100:00100000:2.0:1788587422.257864:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310073216 00000100:00100000:2.0:1788587422.257886:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587422.257892:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310073216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587422.257916:0:21960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587422.257963:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310073216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587422.257969:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788587422.258002:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf10946a00 x1875469310073088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587422.258015:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310073088:0@lo:400:kworker.0 00000100:00100000:2.0:1788587422.258025:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310072960:0@lo:400:kworker.0 00000100:00100000:2.0:1788587422.258050:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3475:1875469310072576:0@lo:400:kworker.0 00010000:00080000:2.0:1788587422.258061:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf10944700 x1875469310072832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587422.258069:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3475:1875469310072832:0@lo:400:kworker.0 00000100:00100000:1.0:1788587422.258235:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310073216:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788587422.326937:0:22600:0:(import.c:65:import_set_state_nolock()) ffff8cbe066fd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587422.327097:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3471:x1875469310072704:12345-0@lo:38:kworker.0 Request processed in 69860us (69921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587422.327108:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788587422.327184:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788587422.327193:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788587422.327198:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788587422.327201:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788587422.327250:0:3471:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004b9611eb): req@ffff8cbf41a2d180 x1875469310065792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587422.327268:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310072704:0@lo:38:kworker.0 00000100:00100000:3.0:1788587422.327367:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310073344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788587422.327405:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587422.327486:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310073344 00000100:00100000:3.0:1788587422.327493:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310073344 00000100:00100000:1.0:1788587422.327552:0:21998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587422.331003:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587422.333840:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310065792 00000100:00100000:3.0:1788587422.333857:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310065792 00000100:00100000:3.0:1788587422.333911:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587422.333920:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3475:x1875469310073344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587422.333960:0:21960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788587422.334044:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3475:x1875469310073344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (6638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587422.334051:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587422.334069:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587422.334075:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21998:x1875469310065792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788587422.334148:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21998:x1875469310065792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (6596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587422.334155:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587422.334178:0:21998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21998:1875469310065792:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788587422.334185:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310073344:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1788587422.334217:0:21998:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788587422.334263:0:21998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21998:1875469310073472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788587422.334303:0:21998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587422.334330:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf032fd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587422.334343:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310073472 00000100:00100000:1.0:1788587422.334346:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310073472 00000100:00100000:1.0:1788587422.334364:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587422.334369:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21998:x1875469310073472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788587422.334835:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:21998:x1875469310073472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 148us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587422.334844:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587422.334873:0:21998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21998:1875469310073472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788587422.334938:0:21998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21998:1875469310073600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788587422.334977:0:21998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587422.335001:0:21998:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf032fd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587422.335378:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310073600 00000100:00100000:0.0:1788587422.335385:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310073600 00000100:00100000:0.0:1788587422.335549:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587422.335559:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:21998:x1875469310073600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788587422.335650:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:21998:x1875469310073600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 93us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587422.335657:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788587422.335833:0:21998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:21998:1875469310073600:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788587422.335877:0:21998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587422.338726:0:21998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788587422.338831:0:21998:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:1.0:1788587422.338837:0:21998:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788587422.960717:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587423.983957:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788587424.281335:0:23012:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd4a2e4b0 20000000:00000080:3.0:1788587424.281354:0:23012:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbf046a1000 uarg=0000000000000000 20000000:01000000:3.0:1788587424.281392:0:23012:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788587424.281398:0:23012:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788587424.281403:0:23012:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788587424.283110:0:23013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788587424.283276:0:23012:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788587424.302304:0:23012:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788587424.302414:0:23012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.302433:0:23012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03483800/0x419e1ae1f6345247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345240 expref: 17 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.302440:0:23012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf03483c00/0x419e1ae1f634534a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345343 expref: 17 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.302460:0:23012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.302498:0:23012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03483c00/0x419e1ae1f634534a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6345343 expref: 17 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.302524:0:23012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf03483c00/0x419e1ae1f634534a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6345343 expref: 17 pid: 21949 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587424.302539:0:23012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23012:1875469310073728:0@lo:104: 00000100:00100000:0.0:1788587424.302601:0:23012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587424.302650:0:23012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf03483800/0x419e1ae1f6345247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6345240 expref: 17 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.302658:0:23012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf03483800/0x419e1ae1f6345247 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6345240 expref: 17 pid: 21948 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587424.302667:0:23012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23012:1875469310073856:0@lo:104: 00000100:00100000:0.0:1788587424.302688:0:23012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587424.302717:0:23012:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587424.302883:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310073728 00000100:00100000:3.0:1788587424.303056:0:21938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310073728 00000100:00100000:3.0:1788587424.303096:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310073856 00000100:00100000:3.0:1788587424.303100:0:21938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310073856 00000100:00100000:3.0:1788587424.303113:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587424.303132:0:21938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+4:23012:x1875469310073728:12345-0@lo:104: 00010000:00010000:3.0:1788587424.303145:0:21938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.303196:0:21938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587424.303202:0:21938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+4:23012:x1875469310073728:12345-0@lo:104: Request processed in 82us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587424.303209:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587424.303224:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587424.303229:0:21938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:23012:x1875469310073856:12345-0@lo:104: 00010000:00010000:3.0:1788587424.303236:0:21938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.303266:0:21938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788587424.303271:0:21938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:23012:x1875469310073856:12345-0@lo:104: Request processed in 42us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587424.303276:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788587424.303299:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587424.303304:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587424.303503:0:23012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23012:1875469310073728:0@lo:104: 00000100:00100000:0.0:1788587424.303524:0:23012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23012:1875469310073856:0@lo:104: 00010000:00010000:0.0:1788587424.303544:0:23012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.303585:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19800 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587424.303590:0:21943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.303608:0:21943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587424.303616:0:21943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587424.303623:0:21943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587424.303657:0:21943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.303664:0:21943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587424.303680:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.303687:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19800/0x419e1ae1f6345343 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634534a expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.304394:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587424.304400:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.304408:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf00030c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587424.304411:0:21943:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.304428:0:21943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587424.304434:0:21943:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587424.304439:0:21943:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587424.304458:0:21943:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.304463:0:21943:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587424.304470:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.304476:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf00030c00/0x419e1ae1f6345240 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345247 expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.304490:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587424.304492:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587424.304493:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587424.304500:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587424.306228:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310073984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587424.306298:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587424.306352:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587424.306359:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310074112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587424.306394:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587424.306412:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310073984 00000100:00100000:0.0:1788587424.306421:0:21941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310073984 00010000:00010000:0.0:1788587424.306452:0:21941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03483c00/0x419e1ae1f634534a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345343 expref: 18 pid: 21949 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587424.306500:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310074112 00000100:00100000:0.0:1788587424.306503:0:21941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310074112 00010000:00010000:0.0:1788587424.306525:0:21941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf03483800/0x419e1ae1f6345247 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345240 expref: 19 pid: 21948 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587424.306538:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587424.306545:0:21941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:3472:x1875469310073984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587424.306557:0:21941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587424.306562:0:21941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03483c00/0x419e1ae1f634534a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345343 expref: 19 pid: 21949 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.306575:0:21941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03483c00/0x419e1ae1f634534a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6345343 expref: 19 pid: 21949 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.306590:0:21941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03483c00/0x419e1ae1f634534a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6345343 expref: 19 pid: 21949 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.306604:0:21941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587424.306640:0:21941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:3472:x1875469310073984:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587424.306646:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587424.306662:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587424.306668:0:21941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:3472:x1875469310074112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587424.306675:0:21941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587424.306679:0:21941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf03483800/0x419e1ae1f6345247 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345240 expref: 17 pid: 21948 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.306689:0:21941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf03483800/0x419e1ae1f6345247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6345240 expref: 17 pid: 21948 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587424.306822:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310073984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587424.308096:0:21941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf03483800/0x419e1ae1f6345247 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6345240 expref: 17 pid: 21948 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.308115:0:21941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.308124:0:21941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.308143:0:21941:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.308150:0:21941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.308157:0:21941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.308164:0:21941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.308171:0:21941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ee00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587424.308174:0:21941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.308182:0:21941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.308205:0:21941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587424.308230:0:21941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587424.308353:0:21941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10947b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+16:3472:x1875469310074112:12345-0@lo:103:ldlm_bl.0 Request processed in 1683us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587424.308361:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788587424.309967:0:23012:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.309981:0:23012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587424.309989:0:23012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499ee00/0x419e1ae1f634539e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587424.311494:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310074112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587425.003021:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788587425.514869:0:21952:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587425.514876:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf02a84800 from 13 10000000:01000000:0.0:1788587425.514880:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587425.514927:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587425.514939:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587425.514949:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587425.514972:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587425.515032:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587425.515067:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587425.515189:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310074240 00000100:00100000:3.0:1788587425.515196:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310074240 00000100:00100000:3.0:1788587425.515297:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788587425.515308:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+16:21952:x1875469310074240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587425.515331:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587425.515363:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27400/0x419e1ae1f63453ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63453a5 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587425.515385:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27400/0x419e1ae1f63453ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63453a5 expref: 17 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587425.515395:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27400/0x419e1ae1f63453ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63453a5 expref: 17 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587425.515404:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27400, rc 0) 00000100:00100000:3.0:1788587425.515441:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:21952:x1875469310074240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587425.515447:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788587425.515702:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587425.515717:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587425.515726:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587425.515786:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587425.515858:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587425.516404:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03263b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587425.521232:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310074368 00000100:00100000:2.0:1788587425.521249:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310074368 00000100:00100000:2.0:1788587425.521311:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587425.521321:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:21952:x1875469310074368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587425.521987:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:21952:x1875469310074368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 665us (6125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587425.521996:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587425.522060:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587425.522118:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587425.522166:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587425.522187:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587425.522204:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310074496 00000100:00100000:2.0:1788587425.522209:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310074496 00000100:00100000:2.0:1788587425.522236:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587425.522243:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:21952:x1875469310074496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587425.522419:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:21952:x1875469310074496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587425.522427:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587425.522474:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788587425.536371:0:23072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788587425.536428:0:21952:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788587425.536448:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587425.536459:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587425.536471:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587425.536481:0:21952:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587425.536484:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf3b397800 from 13 10000000:01000000:2.0:1788587425.536487:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587425.536535:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587425.536554:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587425.536565:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587425.536592:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587425.536659:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587425.536694:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587425.536722:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310074624 00000100:00100000:2.0:1788587425.536727:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310074624 00000100:00100000:2.0:1788587425.536758:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788587425.536766:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+17:21952:x1875469310074624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587425.536778:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587425.536790:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf40c19a00/0x419e1ae1f63453ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63453b3 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587425.536831:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf40c19a00/0x419e1ae1f63453ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63453b3 expref: 18 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587425.536842:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf40c19a00/0x419e1ae1f63453ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63453b3 expref: 18 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587425.536850:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c19a00, rc 0) 00000100:00100000:2.0:1788587425.536883:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:21952:x1875469310074624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587425.536889:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788587425.536926:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587425.536938:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587425.536947:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587425.536983:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587425.537003:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587425.537016:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587425.537781:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310074752 00000100:00100000:3.0:1788587425.537788:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310074752 00000100:00100000:3.0:1788587425.537855:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788587425.537863:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:21952:x1875469310074752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587425.538105:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:21952:x1875469310074752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587425.538112:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788587425.538147:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587425.538188:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587425.538224:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587425.538245:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0627b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587425.538255:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310074880 00000100:00100000:3.0:1788587425.538258:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310074880 00000100:00100000:3.0:1788587425.538272:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788587425.538277:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:21952:x1875469310074880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587425.538409:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:21952:x1875469310074880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587425.538416:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788587425.538449:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310074880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788587425.556400:0:23074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788587425.556657:0:21952:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788587425.556680:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587425.556692:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587425.556703:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587426.028934:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587427.051322:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587427.373180:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587427.373186:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587427.373189:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587427.373192:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587427.373261:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587427.373264:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587427.373266:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587427.373269:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788587427.373862:0:21990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788587427.373958:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310075008:0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.374024:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587427.374064:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310075520:0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.374089:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587427.374110:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587427.374116:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310075136:0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.374139:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587427.374209:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310075264:0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.374234:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587427.374251:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587427.374257:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310075392:0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.374275:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587427.374306:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310075008 00000100:00100000:2.0:1788587427.374313:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310075008 00000100:00100000:2.0:1788587427.374352:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788587427.374361:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:3474:x1875469310075008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.374413:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:3474:x1875469310075008:12345-0@lo:400:kworker.0 Request processed in 53us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587427.374420:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788587427.374449:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310075520 00000100:00100000:2.0:1788587427.374452:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310075520 00000100:00100000:2.0:1788587427.374473:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310075264 00000100:00100000:2.0:1788587427.374477:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310075264 00000100:00100000:2.0:1788587427.374505:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587427.374512:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310075520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.374542:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310075520:12345-0@lo:400:kworker.0 Request processed in 31us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587427.374548:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587427.374559:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587427.374564:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310075264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.374593:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310075264:12345-0@lo:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587427.374599:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587427.374616:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310075136 00000100:00100000:2.0:1788587427.374626:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310075136 00000100:00100000:2.0:1788587427.374648:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310075392 00000100:00100000:2.0:1788587427.374650:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310075392 00000100:00100000:2.0:1788587427.374664:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587427.374669:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469310075136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.374702:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469310075136:12345-0@lo:400:kworker.0 Request processed in 33us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587427.374708:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587427.374720:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587427.374725:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310075392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.374748:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310075392:12345-0@lo:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587427.374753:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587427.375022:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310075392:0@lo:400:kworker.0 00010000:00080000:2.0:1788587427.375034:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf10944000 x1875469310075264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587427.375045:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310075264:0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.375392:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310075136:0@lo:400:kworker.0 00000100:00100000:2.0:1788587427.375401:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310075008:0@lo:400:kworker.0 00010000:00080000:2.0:1788587427.375411:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf10944700 x1875469310075520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587427.375419:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310075520:0@lo:400:kworker.0 00000100:00100000:1.0:1788587427.376321:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587427.376333:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310075648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587427.376377:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587427.376413:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310075648 00000100:00100000:1.0:1788587427.376418:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310075648 00000100:00100000:1.0:1788587427.376456:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587427.376463:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310075648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587427.376506:0:21961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587427.376548:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310075648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587427.376555:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587427.376594:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310075648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587427.377636:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587417/real 1788587417] req@ffff8cbf35d57100 x1875469310068864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587427 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587427.377659:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf35d57100 x1875469310068864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587427 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587427.377667:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587417/real 1788587417] req@ffff8cbf10946d80 x1875469310068736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587427 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587427.377677:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf10946d80 x1875469310068736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587427 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587427.377691:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587427.377707:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788587427.377710:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310068864:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788587427.377726:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587427.377732:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788587427.377735:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310068736:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788587427.378079:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587427.378084:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587427.378087:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587427.378090:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788587427.378093:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587427.378095:0:19211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788587427.378098:0:19211:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587427.378102:0:19211:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 614 00000100:00080000:3.0:1788587427.378107:0:19211:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788587427.378113:0:19211:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cbe03e1a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587427.378138:0:19211:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d57100 x1875469310075776/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587427.378152:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587427.378155:0:19211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788587427.378157:0:19211:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587427.378159:0:19211:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 614 00000100:00080000:3.0:1788587427.378162:0:19211:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788587427.378165:0:19211:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cbe03e1c000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587427.378175:0:19211:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf35d55880 x1875469310075904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587427.378211:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310075776:0@lo:8:kworker.0 00000400:00000100:3.0:1788587427.378252:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310075776 offset 0 length 520: 4 00000100:00100000:3.0:1788587427.378283:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310075904:0@lo:8:kworker.0 00000400:00000100:3.0:1788587427.378300:0:3471:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469310075904 offset 0 length 520: 4 00000100:00100000:0.0:1788587427.381286:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587427.381307:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310076032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587427.381373:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587427.381666:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310076032 00000100:00100000:0.0:1788587427.381675:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310076032 00000100:00100000:0.0:1788587427.381730:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587427.381739:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469310076032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587427.381776:0:21960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587427.381841:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469310076032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587427.381849:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788587427.381893:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310076032:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788587427.424224:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788587428.074949:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587429.108455:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788587429.214202:0:23263:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788587429.214206:0:23263:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788587429.214320:0:23263:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbf195f9800 00000020:01000004:0.0:1788587429.214334:0:23263:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788587429.214347:0:23263:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788587429.214360:0:23263:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cbe037a8000) 00000020:00000080:0.0:1788587429.214435:0:23263:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788587429.231252:0:23263:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788587429.231459:0:23263:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788587429.232266:0:23263:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788587429.232492:0:23263:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788587429.232744:0:23263:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1788587429.233125:0:23263:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 119: rc = 0 00100000:10000000:0.0:1788587429.233215:0:23263:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 119: rc = 0 00100000:10000000:0.0:1788587429.233306:0:23263:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 119: rc = 0 00100000:10000000:0.0:1788587429.233791:0:23263:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 643: rc = 0 00100000:10000000:0.0:1788587429.234135:0:23263:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:0.0:1788587429.234368:0:23263:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:0.0:1788587429.234619:0:23263:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:0.0:1788587429.235083:0:23263:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 643: rc = 0 00100000:10000000:0.0:1788587429.235328:0:23263:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 643: rc = 0 00000020:00000080:0.0:1788587429.235949:0:23263:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788587429.235962:0:23263:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788587429.235971:0:23263:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x419e1ae1f63453c8 00000020:01000004:0.0:1788587429.235979:0:23263:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788587429.236000:0:23263:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788587429.236004:0:23263:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788587429.236009:0:23263:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788587429.236014:0:23263:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788587429.236025:0:23263:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cbf0878b380) 00000020:00000080:0.0:1788587429.236037:0:23263:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788587429.237090:0:23263:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587429.237238:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788587429.237246:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788587429.239268:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788587429.239279:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788587429.241054:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788587429.241066:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788587429.243264:0:23263:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587429.243434:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788587429.243440:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788587429.244593:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788587429.244604:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788587429.259769:0:23263:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587429.260091:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788587429.260097:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788587429.261372:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788587429.261382:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788587429.262254:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788587429.262263:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788587429.264220:0:23263:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587429.264405:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788587429.264411:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788587429.265092:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788587429.265100:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788587429.320615:0:23263:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587429.320983:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788587429.320991:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788587429.323591:0:23263:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788587429.323604:0:23263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788587429.324463:0:23263:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788587429.324496:0:23263:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788587429.324502:0:23263:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788587429.341641:0:23263:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788587429.342155:0:23263:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.114@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788587429.342160:0:23263:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788587429.342162:0:23263:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587429.342164:0:23263:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587429.342165:0:23263:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587429.342167:0:23263:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587429.342168:0:23263:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587429.342170:0:23263:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587429.342172:0:23263:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587429.342173:0:23263:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587429.342177:0:23263:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788587429.342179:0:23263:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788587429.342181:0:23263:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587429.342182:0:23263:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587429.342183:0:23263:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587429.342184:0:23263:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587429.342185:0:23263:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587429.342186:0:23263:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587429.342188:0:23263:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587429.342189:0:23263:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587429.342214:0:23263:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788587429.342234:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076160:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788587429.342313:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.342576:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf3a9786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587429.343356:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310076160 00000100:00100000:1.0:1788587429.343367:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310076160 00000100:00100000:1.0:1788587429.343418:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587429.343426:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:23263:x1875469310076160:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788587429.343482:0:21949:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788587429.343486:0:21949:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788587429.343490:0:21949:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788587429.353395:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:23263:x1875469310076160:12345-0@lo:253:mount.lustre.0 Request processed in 9961us (11073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587429.353423:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788587429.353528:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076160:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788587429.353545:0:23263:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788587429.353548:0:23263:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587429.353550:0:23263:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587429.353551:0:23263:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587429.353552:0:23263:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587429.353554:0:23263:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587429.353561:0:23263:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587429.353563:0:23263:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587429.353565:0:23263:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587429.353566:0:23263:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788587429.353587:0:23263:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbf195f9800 from lustre-OST0000 10000000:01000000:0.0:1788587429.353614:0:23263:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788587429.353617:0:23263:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788587429.353626:0:23263:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbf053ab380 local copy 00010000:00010000:0.0:1788587429.353637:0:23263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587429.353877:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587429.353912:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.353947:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587429.354149:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310076288 00000100:00100000:2.0:1788587429.354162:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310076288 00000100:00100000:2.0:1788587429.354206:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788587429.354215:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:23263:x1875469310076288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587429.354377:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:23263:x1875469310076288:12345-0@lo:501:mount.lustre.0 Request processed in 163us (464us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587429.354386:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788587429.354502:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076288:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788587429.354517:0:23263:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788587429.354654:0:23263:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788587429.354662:0:23263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587429.354934:0:23263:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587429.354959:0:23263:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbf195f9800 10000000:01000000:1.0:1788587429.360747:0:23263:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788587429.360764:0:23263:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788587429.360769:0:23263:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587429.360775:0:23263:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788587429.360778:0:23263:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788587429.361001:0:23263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f63453d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587429.361014:0:23263:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f63453d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587429.361025:0:23263:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f63453d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587429.361050:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587429.361128:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587429.361172:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587429.361262:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310076416 00000100:00100000:2.0:1788587429.361270:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310076416 00000100:00100000:2.0:1788587429.361324:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788587429.361334:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+18:23263:x1875469310076416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587429.361349:0:21949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587429.361362:0:21949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf40c18800/0x419e1ae1f63453dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63453d6 expref: -99 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.361384:0:21949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf40c18800/0x419e1ae1f63453dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63453d6 expref: 19 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.361395:0:21949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf40c18800/0x419e1ae1f63453dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63453d6 expref: 19 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.361404:0:21949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c18800, rc 0) 00000100:00100000:2.0:1788587429.361451:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:23263:x1875469310076416:12345-0@lo:101:mount.lustre.0 Request processed in 119us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587429.361458:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587429.361584:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587429.361598:0:23263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f63453d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453dd expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587429.361608:0:23263:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f63453d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63453dd expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587429.362537:0:23263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788587429.364284:0:23263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587429.364529:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788587429.364594:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788587429.364630:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788587429.364679:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788587429.364713:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788587429.364741:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788587429.364782:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788587429.364843:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788587429.364872:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788587429.364912:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788587429.364944:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788587429.364983:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788587429.365034:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788587429.365042:0:23263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788587429.365120:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587429.365180:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587429.365230:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587429.369652:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310076544 00000100:00100000:3.0:1788587429.369669:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310076544 00000100:00100000:3.0:1788587429.369748:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788587429.369758:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:23263:x1875469310076544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587429.370306:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:23263:x1875469310076544:12345-0@lo:501:mount.lustre.0 Request processed in 548us (5124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587429.370315:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788587429.370886:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587429.370937:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076672:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587429.370987:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587429.371074:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1788587429.372843:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310076672 00000100:00100000:0.0:1788587429.372855:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310076672 00000100:00100000:0.0:1788587429.372979:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788587429.372989:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:23263:x1875469310076672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587429.373361:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:23263:x1875469310076672:12345-0@lo:503:mount.lustre.0 Request processed in 373us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587429.373375:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788587429.373483:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076672:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587429.374499:0:23263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587429.374571:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587429.374631:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587429.380499:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837240 going to sleep for 11 seconds 00000100:00100000:3.0:1788587429.381309:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310076800 00000100:00100000:3.0:1788587429.381319:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310076800 00000100:00100000:2.0:1788587429.381516:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788587429.381528:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:23263:x1875469310076800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587429.382041:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:23263:x1875469310076800:12345-0@lo:502:mount.lustre.0 Request processed in 514us (7407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587429.382070:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587429.382249:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587429.382516:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788587429.382587:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788587429.382623:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788587429.382818:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788587429.382861:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788587429.382893:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788587429.382940:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788587429.382975:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788587429.383006:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788587429.383051:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788587429.383155:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788587429.383202:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788587429.383239:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587429.383296:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587429.383391:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270ea180 going to sleep for 11 seconds 00000100:00100000:2.0:1788587429.383455:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310076928 00000100:00100000:2.0:1788587429.383461:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310076928 00000100:00100000:2.0:1788587429.383501:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587429.383510:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:23263:x1875469310076928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587429.383683:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:23263:x1875469310076928:12345-0@lo:502:mount.lustre.0 Request processed in 174us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587429.383824:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788587429.383971:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310076928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587429.384044:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788587429.384054:0:23263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788587429.385165:0:23277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788587429.385174:0:23277:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788587429.385180:0:23277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587429.385183:0:23277:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788587429.385189:0:23277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788587429.385205:0:23277:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cbf181a19c0) 00000020:00000080:2.0:1788587429.385228:0:23277:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788587429.385234:0:23277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788587429.385293:0:23277:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf195f9800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788587429.385301:0:23277:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788587429.385308:0:23277:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x419e1ae1f63453eb 00010000:00010000:2.0:1788587429.391617:0:23277:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788587429.395300:0:23277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934606 00080000:10000000:2.0:1788587429.398953:0:23277:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1788587429.409565:0:23277:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788587429.409578:0:23277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587429.409585:0:23277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587429.409587:0:23277:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788587429.409591:0:23277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788587429.409594:0:23277:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788587429.409595:0:23277:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587429.409597:0:23277:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587429.409598:0:23277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788587429.409600:0:23277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587429.409602:0:23277:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788587429.409604:0:23277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587429.409607:0:23277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587429.409608:0:23277:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788587429.409612:0:23277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788587429.409614:0:23277:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788587429.409616:0:23277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587429.409618:0:23277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587429.409619:0:23277:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788587429.409622:0:23277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587429.409624:0:23277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587429.409625:0:23277:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788587429.409628:0:23277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788587429.409708:0:23277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587429.409712:0:23277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587429.409714:0:23277:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788587429.409717:0:23277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788587429.416548:0:23263:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788587429.416591:0:23263:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788587429.416618:0:23263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f63453d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453dd expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587429.416631:0:23263:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03483800/0x419e1ae1f63453d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453dd expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587429.416640:0:23263:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf195f9800 from 1 10000000:01000000:1.0:1788587429.416643:0:23263:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587429.416875:0:23263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587429.416899:0:23263:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587429.416910:0:23263:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587429.416933:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587429.416997:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587429.417096:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34837240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587429.424986:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310077056 00000100:00100000:0.0:1788587429.424998:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310077056 00000100:00100000:0.0:1788587429.425086:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788587429.425097:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:23263:x1875469310077056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587429.425112:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587429.425129:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63453f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63453f2 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587429.425155:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63453f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63453f2 expref: 20 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587429.425166:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63453f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63453f2 expref: 20 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587429.425175:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fc00, rc 0) 00000100:00100000:0.0:1788587429.425242:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:23263:x1875469310077056:12345-0@lo:101:mount.lustre.0 Request processed in 147us (8245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587429.425248:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788587429.426983:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587429.427006:0:23263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587429.427018:0:23263:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587429.428415:0:23263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788587429.430371:0:23263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587429.430680:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788587429.446400:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788587429.446484:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788587429.446520:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788587429.446550:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788587429.446591:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788587429.446625:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788587429.446656:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788587429.446730:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788587429.446766:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788587429.447383:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788587429.447489:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788587429.447497:0:23263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788587429.447592:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587429.447654:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.447709:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587429.448501:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310077184 00000100:00100000:1.0:1788587429.448509:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310077184 00000100:00100000:1.0:1788587429.448560:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788587429.448569:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:23263:x1875469310077184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587429.449194:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:23263:x1875469310077184:12345-0@lo:501:mount.lustre.0 Request processed in 623us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587429.449203:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788587429.449393:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587429.449437:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587429.449500:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.449533:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587429.449581:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310077312 00000100:00100000:2.0:1788587429.449587:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310077312 00000100:00100000:2.0:1788587429.449624:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788587429.449632:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:23263:x1875469310077312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587429.450181:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:23263:x1875469310077312:12345-0@lo:503:mount.lustre.0 Request processed in 548us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587429.450198:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587429.453352:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077312:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788587429.454252:0:23263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587429.454338:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587429.454409:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.454494:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587429.454539:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310077440 00000100:00100000:1.0:1788587429.454546:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310077440 00000100:00100000:1.0:1788587429.454629:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788587429.454639:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:23263:x1875469310077440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587429.455130:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:23263:x1875469310077440:12345-0@lo:502:mount.lustre.0 Request processed in 491us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587429.455138:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788587429.455217:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077440:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587429.455436:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788587429.455494:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788587429.455544:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788587429.455579:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788587429.455612:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788587429.455676:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788587429.455728:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788587429.455761:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788587429.456140:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788587429.456185:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788587429.456219:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788587429.456253:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587429.456305:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587429.456527:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf348379c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587429.456597:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310077568 00000100:00100000:2.0:1788587429.456603:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310077568 00000100:00100000:2.0:1788587429.457179:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788587429.457188:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:23263:x1875469310077568:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587429.457411:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:23263:x1875469310077568:12345-0@lo:502:mount.lustre.0 Request processed in 223us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587429.457418:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788587429.457511:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587429.457622:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788587429.457634:0:23263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788587429.458561:0:23281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587429.458570:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587429.458573:0:23281:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788587429.458579:0:23281:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf195f9800 00000020:00000080:1.0:1788587429.458581:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587429.458588:0:23281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587429.458591:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587429.458592:0:23281:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788587429.458594:0:23281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587429.458596:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587429.458598:0:23281:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788587429.458601:0:23281:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf195f9800 00000020:00000080:1.0:1788587429.458603:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587429.458861:0:23281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587429.458865:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587429.458867:0:23281:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788587429.458870:0:23281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587429.458872:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587429.458874:0:23281:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587429.458877:0:23281:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf195f9800 00000020:00000080:1.0:1788587429.458880:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587429.461867:0:23281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587429.461879:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587429.461881:0:23281:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587429.461887:0:23281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587429.461891:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587429.461893:0:23281:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788587429.461897:0:23281:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf195f9800 00000020:00000080:1.0:1788587429.461899:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587429.461999:0:23281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587429.462003:0:23281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587429.462005:0:23281:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788587429.462008:0:23281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788587429.462565:0:23263:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788587429.462595:0:23263:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587429.462621:0:23263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587429.462634:0:23263:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587429.462679:0:23263:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788587429.462683:0:23263:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbf195f9800 10000000:01000000:0.0:1788587429.462828:0:23263:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbf195f9800 10000000:01000000:0.0:1788587429.462832:0:23263:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587429.462894:0:23263:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf195f9800 from 1 10000000:01000000:0.0:1788587429.462897:0:23263:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788587429.462932:0:23263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e200/0x419e1ae1f6345400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587429.462942:0:23263:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e200/0x419e1ae1f6345400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587429.462952:0:23263:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e200/0x419e1ae1f6345400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587429.462983:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587429.463043:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.463195:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587429.463269:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310077696 00000100:00100000:3.0:1788587429.463276:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310077696 00000100:00100000:3.0:1788587429.463321:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788587429.463330:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:23263:x1875469310077696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587429.463342:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587429.463354:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f6345407 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345400 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.463388:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f6345407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345400 expref: 21 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.463399:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27a00/0x419e1ae1f6345407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345400 expref: 21 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.463407:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27a00, rc 0) 00000100:00100000:3.0:1788587429.463444:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310077696:12345-0@lo:101:mount.lustre.0 Request processed in 115us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587429.463451:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587429.464015:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077696:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587429.464030:0:23263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e200/0x419e1ae1f6345400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345407 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587429.464040:0:23263:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e200/0x419e1ae1f6345400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345407 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587429.465313:0:23263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788587429.465619:0:23263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587429.467493:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788587429.467547:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788587429.467580:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788587429.467628:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788587429.467662:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788587429.470046:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788587429.470099:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788587429.470130:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788587429.470171:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788587429.470208:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788587429.470241:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788587429.470280:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788587429.470313:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788587429.470345:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788587429.470384:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788587429.470439:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788587429.470482:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788587429.470540:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788587429.470576:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788587429.470605:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788587429.470645:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788587429.470681:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788587429.472008:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788587429.472104:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788587429.472153:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788587429.472188:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788587429.473019:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788587429.473070:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788587429.473104:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788587429.473149:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788587429.473181:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788587429.473230:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788587429.473260:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788587429.473308:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788587429.473342:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788587429.473385:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788587429.473421:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788587429.473448:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788587429.475226:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788587429.475336:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788587429.475379:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788587429.475413:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788587429.475560:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788587429.475624:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788587429.475658:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788587429.475708:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788587429.475746:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788587429.475790:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788587429.475873:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788587429.475892:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788587429.475937:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788587429.475942:0:23263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788587429.476033:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587429.476090:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587429.476123:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310077824 00000100:00100000:0.0:1788587429.476126:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587429.476132:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310077824 00000100:00100000:2.0:1788587429.476191:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587429.476201:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310077824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587429.476528:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310077824:12345-0@lo:501:mount.lustre.0 Request processed in 328us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587429.476536:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788587429.476603:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587429.476636:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077952:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587429.476947:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.476975:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310077952 00000100:00100000:0.0:1788587429.476979:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310077952 00000100:00100000:0.0:1788587429.477008:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788587429.477016:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf115d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310077952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587429.477381:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf115d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310077952:12345-0@lo:503:mount.lustre.0 Request processed in 365us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587429.477389:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788587429.477440:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587429.477457:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310077952:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788587429.479433:0:23263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587429.479521:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310078080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587429.479580:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.479617:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587429.479620:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310078080 00000100:00100000:1.0:1788587429.479626:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310078080 00000100:00100000:1.0:1788587429.479667:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788587429.479677:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf115d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310078080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587429.480039:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf115d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310078080:12345-0@lo:502:mount.lustre.0 Request processed in 362us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587429.480048:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788587429.480072:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310078080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788587429.480406:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788587429.480467:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788587429.480586:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788587429.480658:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788587429.480772:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788587429.480854:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788587429.480894:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788587429.480934:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788587429.481000:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788587429.481065:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788587429.481115:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788587429.481172:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788587429.481211:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788587429.481254:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788587429.481306:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788587429.481343:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788587429.481381:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788587429.481450:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788587429.481575:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788587429.481615:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788587429.481741:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788587429.481784:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788587429.481843:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788587429.481895:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788587429.481935:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788587429.481988:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788587429.482040:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788587429.482078:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788587429.482117:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788587429.482177:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788587429.482218:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788587429.482254:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788587429.482560:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788587429.482626:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788587429.482680:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788587429.482732:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788587429.482782:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788587429.482850:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788587429.482908:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788587429.482966:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788587429.483019:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788587429.483100:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788587429.483198:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788587429.483273:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788587429.483340:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788587429.483422:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788587429.483665:0:22612:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788587429.483817:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788587429.483867:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788587429.483948:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310078208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587429.484022:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.484072:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587429.484394:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310078208 00000100:00100000:1.0:1788587429.484402:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310078208 00000100:00100000:1.0:1788587429.484448:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788587429.484459:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310078208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587429.485094:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310078208:12345-0@lo:502:mount.lustre.0 Request processed in 636us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587429.485103:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788587429.485214:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310078208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788587429.485402:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788587429.485447:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788587429.485481:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310078336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587429.485830:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.485859:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587429.486073:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310078336 00000100:00100000:1.0:1788587429.486079:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310078336 00000100:00100000:1.0:1788587429.486112:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788587429.486120:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310078336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587429.486675:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310078336:12345-0@lo:502:mount.lustre.0 Request processed in 555us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587429.486683:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788587429.486831:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310078336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788587429.486935:0:23263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788587429.486950:0:23263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788587429.489236:0:23286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788587429.489252:0:23286:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cbe052e8000) 00000020:00000080:1.0:1788587429.489279:0:23286:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788587429.489437:0:23286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf195f9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788587429.489442:0:23286:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf195f9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788587429.489445:0:23286:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf195f9800 3 00010000:00080000:1.0:1788587429.489483:0:23286:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf3abba000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.114@tcp at head 00010000:00010000:1.0:1788587429.492230:0:23286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788587429.493084:0:23286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788587429.493122:0:23286:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788587429.493135:0:23286:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x419e1ae1f6345415 00000100:00080000:1.0:1788587429.493146:0:23286:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788587429.493153:0:23286:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cbf3abba000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:1.0:1788587429.493187:0:23286:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf3bd51f80 x1875469310078464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788587429.493213:0:23286:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788587429.493255:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587429.493259:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587429.493262:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587429.493265:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587429.493358:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310078464:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788587429.493381:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587429.493385:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587429.493388:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587429.493391:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788587429.493424:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310078720:0@lo:400:kworker.0 00000100:00100000:2.0:1788587429.493432:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587429.493507:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310078464 00000100:00100000:2.0:1788587429.493514:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310078464 00000100:00100000:2.0:1788587429.493544:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587429.493550:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310078464:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788587429.493573:0:21956:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:2.0:1788587429.493602:0:21956:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x419e1ae1f634541c 00000004:00100000:2.0:1788587429.493617:0:21956:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788587429.493647:0:21956:0:(import.c:65:import_set_state_nolock()) ffff8cbf391c3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587429.493706:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3471:x1875469310078464:12345-0@lo:38:llog_process_th.0 Request processed in 154us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587429.493714:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587429.493748:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788587429.493753:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf3bd51f80 x1875469310078464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587429.493763:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587429.493772:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788587429.493780:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788587429.493785:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788587429.493787:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3abba000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587429.493857:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3471:1875469310078464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587429.493888:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310078720 00000100:00100000:2.0:1788587429.493892:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310078720 00000100:00100000:1.0:1788587429.493893:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587429.493903:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310078848:0@lo:400:kworker.0 00000100:00100000:2.0:1788587429.493923:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587429.493930:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310078720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587429.493937:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587429.493975:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310078848 00000100:00100000:1.0:1788587429.493979:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310078848 00000100:00100000:1.0:1788587429.494005:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587429.494012:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310078848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587429.494050:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310078848:12345-0@lo:400:kworker.0 Request processed in 38us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587429.494056:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587429.494083:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310078848:0@lo:400:kworker.0 00000100:00100000:0.0:1788587429.494361:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310078592:0@lo:400:kworker.0 00000100:00100000:0.0:1788587429.494390:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.494415:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587429.494417:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310078720:12345-0@lo:400:kworker.0 Request processed in 485us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587429.494423:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310078976:0@lo:400:kworker.0 00000100:00100000:2.0:1788587429.494427:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587429.494461:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587429.494507:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310078592 00000100:00100000:0.0:1788587429.494516:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310078592 00000100:00100000:0.0:1788587429.494545:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587429.494552:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310078592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587429.494587:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310078592:12345-0@lo:400:kworker.0 Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587429.494594:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587429.494620:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310078976 00000100:00100000:0.0:1788587429.494624:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310078976 00000100:00100000:0.0:1788587429.494645:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587429.494652:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310078976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587429.494696:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310078976:12345-0@lo:400:kworker.0 Request processed in 45us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587429.494703:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788587429.494746:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf3bd51500 x1875469310078976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587429.494756:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310078976:0@lo:400:kworker.0 00000100:00100000:0.0:1788587429.494771:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310078592:0@lo:400:kworker.0 00010000:00080000:1.0:1788587429.495341:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf3bd52680 x1875469310078720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587429.495353:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310078720:0@lo:400:kworker.0 00000020:01000004:1.0:1788587429.496960:0:23286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788587429.496976:0:23286:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8cbf41a34d40) 00000020:00000080:1.0:1788587429.496999:0:23286:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788587429.497065:0:23286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf195f9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788587429.497070:0:23286:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf195f9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788587429.497073:0:23286:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf195f9800 3 00010000:00080000:1.0:1788587429.497101:0:23286:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf3abbe800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.114@tcp at head 00010000:00010000:0.0:1788587429.502943:0:23286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788587429.503195:0:23286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788587429.503251:0:23286:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788587429.503264:0:23286:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x419e1ae1f634542a 00000100:00080000:0.0:1788587429.503275:0:23286:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587429.503294:0:23286:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8cbf3abbe800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587429.503331:0:23286:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf41a2df80 x1875469310079104/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587429.503366:0:23286:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788587429.503385:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3471:1875469310079104:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587429.503450:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788587429.503481:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587429.503487:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587429.503489:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587429.503492:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587429.503503:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587429.503505:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587429.503508:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587429.503518:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788587429.503708:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310079104 00000100:00100000:0.0:1788587429.503715:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310079104 00000100:00100000:0.0:1788587429.503752:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587429.503760:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310079104:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788587429.503784:0:21956:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:0.0:1788587429.503847:0:21956:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x419e1ae1f6345431 00000004:00100000:0.0:1788587429.503862:0:21956:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788587429.503890:0:21956:0:(import.c:65:import_set_state_nolock()) ffff8cbf41b13800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587429.503947:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3471:x1875469310079104:12345-0@lo:38:llog_process_th.0 Request processed in 186us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587429.503956:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788587429.503971:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbf41a2df80 x1875469310079104/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587429.503983:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587429.503991:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788587429.503997:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788587429.504009:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788587429.504012:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3abbe800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587429.504018:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3471:1875469310079104:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788587429.505887:0:23286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788587429.506054:0:23263:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788587429.506086:0:23263:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788587429.506102:0:23263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e200/0x419e1ae1f6345400 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345407 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587429.506112:0:23263:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf0499e200/0x419e1ae1f6345400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345407 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788587429.506153:0:23263:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788587429.506155:0:23263:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788587429.506157:0:23263:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587429.506158:0:23263:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587429.506159:0:23263:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587429.506161:0:23263:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587429.506162:0:23263:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587429.506164:0:23263:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587429.506165:0:23263:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587429.506169:0:23263:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788587429.506172:0:23263:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587429.506173:0:23263:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788587429.506174:0:23263:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587429.506175:0:23263:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587429.506176:0:23263:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587429.506177:0:23263:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587429.506178:0:23263:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587429.506179:0:23263:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587429.506180:0:23263:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788587429.506202:0:23263:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788587429.506218:0:23263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310079232:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788587429.506290:0:23263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587429.506765:0:23263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587429.506921:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310079232 00000100:00100000:2.0:1788587429.506928:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310079232 00000100:00100000:3.0:1788587429.507092:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788587429.507102:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23263:x1875469310079232:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788587429.507129:0:21949:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788587429.507142:0:21949:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788587429.556013:0:21949:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788587429.556070:0:21949:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788587429.558135:0:21971:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788587429.558143:0:21971:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788587429.558248:0:21971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.558268:0:21971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f27c00/0x419e1ae1f6345382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634537b expref: 21 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.558275:0:21971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6345390 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345389 expref: 21 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.558282:0:21971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.561010:0:21971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6345390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6345389 expref: 21 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.561032:0:21971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6345390 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6345389 expref: 21 pid: 21948 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587429.561047:0:21971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310079360:0@lo:104: 00000100:00100000:2.0:1788587429.561102:0:21971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587429.561205:0:21971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f27c00/0x419e1ae1f6345382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634537b expref: 21 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.561214:0:21971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f27c00/0x419e1ae1f6345382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634537b expref: 21 pid: 21947 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587429.561239:0:21971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310079488:0@lo:104: 00000100:00100000:2.0:1788587429.561261:0:21971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587429.561408:0:21971:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf119139c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587429.561487:0:21938:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788587429.561504:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310079360 00000100:00100000:3.0:1788587429.561509:0:21938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310079360 00000100:00100000:3.0:1788587429.561540:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310079488 00000100:00100000:3.0:1788587429.561542:0:21938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310079488 00000100:00100000:3.0:1788587429.561552:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587429.561559:0:21938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+4:21971:x1875469310079360:12345-0@lo:104: 00010000:00010000:3.0:1788587429.561570:0:21938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.561626:0:21938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587429.561637:0:21938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+4:21971:x1875469310079360:12345-0@lo:104: Request processed in 78us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587429.561643:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587429.561658:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587429.561663:0:21938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf0ce67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:21971:x1875469310079488:12345-0@lo:104: 00010000:00010000:3.0:1788587429.561670:0:21938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.561711:0:21938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788587429.561717:0:21938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf0ce67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:21971:x1875469310079488:12345-0@lo:104: Request processed in 53us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587429.561729:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788587429.561764:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587429.561770:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.561776:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19200 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587429.561781:0:21944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.561789:0:21944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587429.561816:0:21944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587429.561822:0:21944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587429.561846:0:21944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.561861:0:21944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587429.561880:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.561887:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf40c19200/0x419e1ae1f6345389 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345390 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.561898:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587429.561901:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.561906:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fe00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:3.0:1788587429.561909:0:21944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.561916:0:21944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587429.561922:0:21944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587429.561927:0:21944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587429.561936:0:21944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.561941:0:21944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587429.561952:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.561958:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fe00/0x419e1ae1f634537b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345382 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587429.562058:0:21971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310079360:0@lo:104: 00000100:00100000:2.0:1788587429.562066:0:21971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310079488:0@lo:104: 00010000:00010000:2.0:1788587429.562082:0:21971:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587429.562169:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587429.562172:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587429.562173:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587429.562180:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587429.562190:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3473:1875469310079616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587429.562217:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587429.562258:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310079744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587429.562280:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587429.562560:0:21940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310079616 00000100:00100000:2.0:1788587429.562565:0:21940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310079616 00010000:00010000:2.0:1788587429.562582:0:21940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6345390 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345389 expref: 22 pid: 21948 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587429.562602:0:21940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310079744 00000100:00100000:2.0:1788587429.562605:0:21940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310079744 00010000:00010000:2.0:1788587429.562615:0:21940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f27c00/0x419e1ae1f6345382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634537b expref: 23 pid: 21947 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587429.562626:0:21940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587429.562631:0:21940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:3473:x1875469310079616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587429.562640:0:21940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587429.562645:0:21940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6345390 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345389 expref: 23 pid: 21948 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.562654:0:21940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6345390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6345389 expref: 23 pid: 21948 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.562665:0:21940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499ec00/0x419e1ae1f6345390 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6345389 expref: 23 pid: 21948 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563075:0:21940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587429.563117:0:21940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:3473:x1875469310079616:12345-0@lo:103:ldlm_bl.0 Request processed in 484us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587429.563124:0:21940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587429.563138:0:21940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587429.563144:0:21940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf33bbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:3474:x1875469310079744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587429.563151:0:21940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587429.563155:0:21940:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f27c00/0x419e1ae1f6345382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634537b expref: 21 pid: 21947 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563164:0:21940:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f27c00/0x419e1ae1f6345382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634537b expref: 21 pid: 21947 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563175:0:21940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f27c00/0x419e1ae1f6345382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634537b expref: 21 pid: 21947 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563190:0:21940:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563198:0:21940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788587429.563210:0:21940:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005067959s 00010000:00010000:2.0:1788587429.563214:0:21940:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563221:0:21940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563237:0:21940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563244:0:21940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563249:0:21940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c18400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587429.563253:0:21940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563270:0:21940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563283:0:21940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563291:0:21940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587429.563386:0:21940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf33bbf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:3474:x1875469310079744:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587429.563392:0:21940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788587429.563434:0:21971:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563441:0:21971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587429.563448:0:21971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf40c18400/0x419e1ae1f6345438 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587429.563666:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310079744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587429.567621:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3473:1875469310079616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587429.580247:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:23263:x1875469310079232:12345-0@lo:253:mount.lustre.0 Request processed in 73137us (73949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587429.580261:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788587429.580364:0:23263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23263:1875469310079232:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788587429.580379:0:23263:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788587429.580382:0:23263:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788587429.580384:0:23263:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788587429.580385:0:23263:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587429.580386:0:23263:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587429.580387:0:23263:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587429.580388:0:23263:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587429.580390:0:23263:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587429.580392:0:23263:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587429.580393:0:23263:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788587429.580408:0:23263:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788587429.581075:0:23263:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587429.581240:0:23263:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587429.581415:0:23263:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587429.582000:0:23263:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587429.582163:0:23263:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587429.582305:0:23263:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788587429.583392:0:23263:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788587429.644725:0:23263:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788587429.644732:0:23263:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788587429.644764:0:23263:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788587429.644841:0:23263:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788587429.644853:0:23263:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788587429.644879:0:23263:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788587430.125620:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587430.506884:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587415/real 1788587415] req@ffff8cbf41a2ca80 x1875469310066816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587430 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587430.506916:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf41a2ca80 x1875469310066816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587430 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587430.506926:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587415/real 1788587415] req@ffff8cbf41a2f100 x1875469310066944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587430 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587430.506936:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf41a2f100 x1875469310066944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587430 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788587430.506956:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587430.506984:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587430.506988:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310066816:0@lo:8:kworker.0 00000100:00080000:2.0:1788587430.506993:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587430.506999:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788587430.507001:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310066944:0@lo:8:kworker.0 00000100:00080000:0.0:1788587430.507149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587430.507153:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788587430.507156:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587430.507162:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:0.0:1788587430.507167:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788587430.507173:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cbf10d0f800 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587430.507194:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf41a2e680 x1875469310080128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587430.507208:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587430.507211:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788587430.507213:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587430.507224:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:0.0:1788587430.507227:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788587430.507231:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10d7a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587430.507245:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf41a2f480 x1875469310080256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587430.507266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587430.507270:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587430.507272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587430.507274:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788587430.507308:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310080512:0@lo:400:kworker.0 00000100:00100000:0.0:1788587430.507372:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587430.507404:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788587430.507410:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310079872:0@lo:400:kworker.0 00000100:00100000:0.0:1788587430.507452:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587430.507487:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310080640:0@lo:400:kworker.0 00000100:00100000:0.0:1788587430.507513:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587430.507539:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310080000:0@lo:400:kworker.0 00000100:00100000:0.0:1788587430.507562:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587430.507578:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310080768:0@lo:400:kworker.0 00000100:00100000:0.0:1788587430.507599:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587430.507886:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788587430.507893:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310080384:0@lo:400:kworker.0 00000100:00100000:0.0:1788587430.507918:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587430.507978:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310080896:0@lo:400:kworker.0 00000100:00100000:0.0:1788587430.508012:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587430.508105:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310079872 00000100:00100000:1.0:1788587430.508114:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310079872 00000100:00100000:1.0:1788587430.508161:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587430.508172:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:3474:x1875469310079872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587430.508228:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:3474:x1875469310079872:12345-0@lo:400:kworker.0 Request processed in 58us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587430.508235:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788587430.509672:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310079872:0@lo:400:kworker.0 00000100:00100000:1.0:1788587430.509729:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310080512 00000100:00100000:1.0:1788587430.509735:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310080512 00000100:00100000:1.0:1788587430.509774:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310080000 00000100:00100000:1.0:1788587430.509777:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310080000 00000100:00100000:1.0:1788587430.509825:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587430.509843:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310080512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587430.509916:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3474:x1875469310080512:12345-0@lo:400:kworker.0 Request processed in 75us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587430.509924:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587430.509941:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788587430.509947:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310080000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587430.509983:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310080000:12345-0@lo:400:kworker.0 Request processed in 36us (2419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587430.509990:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788587430.510020:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310080128:0@lo:8:kworker.0 00000100:00100000:1.0:1788587430.510057:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587430.510091:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310080256:0@lo:8:kworker.0 00000100:00100000:1.0:1788587430.510116:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587430.510155:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310080512:0@lo:400:kworker.0 00000100:00100000:0.0:1788587430.513632:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310080000:0@lo:400:kworker.0 00000100:00100000:3.0:1788587430.513977:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310080128 00000100:00100000:3.0:1788587430.513986:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310080128 00000100:00100000:3.0:1788587430.514661:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310080256 00000100:00100000:3.0:1788587430.514678:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310080256 00000100:00100000:3.0:1788587430.514697:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587430.514705:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310080128:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788587430.514737:0:23265:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 628 last 0 00000020:00000080:3.0:1788587430.514766:0:23265:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f634543f 00002000:00100000:3.0:1788587430.514780:0:23265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cbf062a2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788587430.514785:0:23265:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788587430.514787:0:23265:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788587430.515765:0:23265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788587430.515823:0:23265:0:(import.c:65:import_set_state_nolock()) ffff8cbf062a4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587430.515907:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3471:x1875469310080128:12345-0@lo:8:kworker.0 Request processed in 1200us (5848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587430.515915:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587430.515934:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587430.515940:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310080256:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788587430.515956:0:23265:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788587430.515984:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310080256:12345-0@lo:8:kworker.0 Request processed in 44us (5867us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587430.516682:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587430.516749:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf41a2e680 x1875469310080128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587430.516760:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587430.516769:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788587430.516778:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788587430.516783:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788587430.516785:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d0f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788587430.516842:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788587430.516849:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310080128:0@lo:8:kworker.0 00000100:00080000:3.0:1788587430.516870:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587430.516874:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788587430.516876:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310080256:0@lo:8:kworker.0 00000100:00100000:2.0:1788587430.518429:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310080640 00000100:00100000:2.0:1788587430.518442:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310080640 00000100:00100000:2.0:1788587430.518499:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310080768 00000100:00100000:2.0:1788587430.518502:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310080768 00000100:00080000:2.0:1788587430.518538:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587430.518554:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310080384 00000100:00100000:2.0:1788587430.518557:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310080384 00000100:00100000:2.0:1788587430.518568:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310080896 00000100:00100000:2.0:1788587430.518571:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310080896 00000100:00080000:2.0:1788587430.518582:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587430.518599:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788587430.518607:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310080640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587430.518819:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310080640:12345-0@lo:400:kworker.0 Request processed in 211us (11304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587430.518826:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788587430.518865:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf41a2f100 x1875469310080640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587430.518879:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310080640:0@lo:400:kworker.0 00000100:00100000:2.0:1788587430.518908:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587430.518915:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310080768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587430.518953:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310080768:12345-0@lo:400:kworker.0 Request processed in 40us (11353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587430.518960:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587430.518972:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587430.518979:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310080384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587430.519008:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310080384:12345-0@lo:400:kworker.0 Request processed in 29us (11088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587430.519013:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587430.519024:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587430.519029:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310080896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587430.519054:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310080896:12345-0@lo:400:kworker.0 Request processed in 26us (11042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587430.519060:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788587430.519275:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf41a2e300 x1875469310080384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587430.519287:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310080384:0@lo:400:kworker.0 00010000:00080000:2.0:1788587430.519309:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf41a2c380 x1875469310080896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587430.519319:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310080896:0@lo:400:kworker.0 00010000:00080000:2.0:1788587430.519328:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf41a2ca80 x1875469310080768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587430.519337:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310080768:0@lo:400:kworker.0 00000004:00080000:0.0:1788587430.519491:0:21980:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1788587430.519513:0:21980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21980:1875469310081152:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788587430.519553:0:21980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587430.519576:0:21980:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36a5cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587430.519595:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310081152 00000100:00100000:0.0:1788587430.519599:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310081152 00000100:00100000:0.0:1788587430.519647:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587430.519655:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:21980:x1875469310081152:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788587430.520910:0:21979:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:2.0:1788587430.521597:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587430.521621:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587430.521641:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310081024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587430.521701:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788587430.522146:0:21979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 628271350270ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788587430.527358:0:23268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310081024 00000100:00100000:0.0:1788587430.527372:0:23268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310081024 00000100:00100000:0.0:1788587430.527871:0:23269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587430.527882:0:23269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3475:x1875469310081024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587430.527906:0:23269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788587430.527987:0:23269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3475:x1875469310081024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (6285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587430.527994:0:23269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788587430.529217:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe03da3480 x1875469310081024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587430.529243:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310081024:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788587430.536843:0:23265:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788587430.536856:0:23265:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788587430.536863:0:23265:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:1.0:1788587430.564081:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.564091:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345446 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.564108:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.564112:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.564118:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.564151:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.564163:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.564171:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.564190:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587430.564202:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587430.564207:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.564214:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587430.564218:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.564227:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345446 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.564243:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345446 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.564251:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000579f7cf6/0x419e1ae1f6345446 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.564273:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.564274:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.564276:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788587430.569213:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788587430.569985:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.570000:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000663a469a/0x419e1ae1f634544d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.570017:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.570021:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.570028:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000663a469a/0x419e1ae1f634544d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.570042:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000663a469a/0x419e1ae1f634544d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.570053:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000663a469a/0x419e1ae1f634544d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.570070:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000663a469a/0x419e1ae1f634544d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.570092:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.570114:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.570123:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000663a469a/0x419e1ae1f634544d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.570133:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.570138:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000663a469a/0x419e1ae1f634544d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.570148:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000663a469a/0x419e1ae1f634544d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.570168:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000663a469a/0x419e1ae1f634544d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.570176:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000663a469a/0x419e1ae1f634544d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.570200:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.570201:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.570203:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587430.570613:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.570619:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6345454 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.570637:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.570640:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.570644:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6345454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.570653:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6345454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.570660:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6345454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.570667:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6345454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.570689:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.570712:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.570719:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6345454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.570727:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482c00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.570731:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6345454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.570741:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6345454 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.570753:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6345454 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.570761:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f6345454 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.570776:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.570777:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.570779:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587430.571352:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.571359:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c6bb2d6/0x419e1ae1f634545b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.571456:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.571460:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.571474:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c6bb2d6/0x419e1ae1f634545b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.571485:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c6bb2d6/0x419e1ae1f634545b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.571503:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c6bb2d6/0x419e1ae1f634545b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.571510:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c6bb2d6/0x419e1ae1f634545b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.571528:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.571567:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.571574:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c6bb2d6/0x419e1ae1f634545b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.571596:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.571600:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c6bb2d6/0x419e1ae1f634545b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.571609:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c6bb2d6/0x419e1ae1f634545b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.571621:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c6bb2d6/0x419e1ae1f634545b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.571628:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c6bb2d6/0x419e1ae1f634545b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.571645:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.571648:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.571649:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587430.572216:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.572222:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6345462 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.572230:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.572233:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.572237:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6345462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.572245:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6345462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.572252:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6345462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.572259:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6345462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.572292:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.572443:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.572450:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6345462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.572458:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483c00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.572471:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6345462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.572480:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6345462 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.572499:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6345462 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.572505:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a6c6466/0x419e1ae1f6345462 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.572525:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.572527:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.572530:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587430.572719:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.572725:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f6345469 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.572733:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.572736:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.572740:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f6345469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.572764:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f6345469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.572774:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f6345469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.572782:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f6345469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.572815:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.572835:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.572841:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f6345469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.572847:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.572850:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f6345469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.572859:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f6345469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.572871:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f6345469 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.572878:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f6345469 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.572906:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.572907:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.572910:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587430.573274:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.573280:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000881a0a0d/0x419e1ae1f6345470 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.573289:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.573298:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.573303:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000881a0a0d/0x419e1ae1f6345470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.573313:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000881a0a0d/0x419e1ae1f6345470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.573321:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000881a0a0d/0x419e1ae1f6345470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.573329:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000881a0a0d/0x419e1ae1f6345470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.573345:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.573368:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.573374:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000881a0a0d/0x419e1ae1f6345470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.573381:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03483000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.573384:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000881a0a0d/0x419e1ae1f6345470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.573392:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000881a0a0d/0x419e1ae1f6345470 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.573403:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000881a0a0d/0x419e1ae1f6345470 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.573411:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000881a0a0d/0x419e1ae1f6345470 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.573425:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.573427:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.573428:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587430.577103:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.577115:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046221832/0x419e1ae1f6345477 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.577203:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.577208:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.577215:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046221832/0x419e1ae1f6345477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.577230:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046221832/0x419e1ae1f6345477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.577241:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046221832/0x419e1ae1f6345477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.577258:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046221832/0x419e1ae1f6345477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.577286:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.578106:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.578115:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046221832/0x419e1ae1f6345477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.578137:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482a00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.578142:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046221832/0x419e1ae1f6345477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.578150:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046221832/0x419e1ae1f6345477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.578168:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046221832/0x419e1ae1f6345477 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.578175:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046221832/0x419e1ae1f6345477 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.578199:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.578201:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.578203:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587430.579690:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.579701:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003849fcea/0x419e1ae1f634547e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.579717:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.579722:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.579728:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003849fcea/0x419e1ae1f634547e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.579742:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003849fcea/0x419e1ae1f634547e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.580767:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003849fcea/0x419e1ae1f634547e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.580782:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003849fcea/0x419e1ae1f634547e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.580823:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.580849:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.580858:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003849fcea/0x419e1ae1f634547e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.580870:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cdc00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.580875:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003849fcea/0x419e1ae1f634547e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.580887:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003849fcea/0x419e1ae1f634547e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.580913:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003849fcea/0x419e1ae1f634547e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.580922:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003849fcea/0x419e1ae1f634547e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.580946:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.580949:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.580952:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587430.581981:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.581989:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006db4e21a/0x419e1ae1f6345485 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.582010:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.582014:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.582022:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006db4e21a/0x419e1ae1f6345485 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.582106:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006db4e21a/0x419e1ae1f6345485 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.582116:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006db4e21a/0x419e1ae1f6345485 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.582188:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006db4e21a/0x419e1ae1f6345485 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.582216:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.582503:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.582510:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006db4e21a/0x419e1ae1f6345485 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.582519:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cda00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.582524:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006db4e21a/0x419e1ae1f6345485 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.582533:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006db4e21a/0x419e1ae1f6345485 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.582559:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006db4e21a/0x419e1ae1f6345485 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.582567:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006db4e21a/0x419e1ae1f6345485 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.582606:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.582608:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.582610:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587430.583117:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.583124:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd510e/0x419e1ae1f634548c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.583136:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.583140:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.583144:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd510e/0x419e1ae1f634548c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.583155:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079dd510e/0x419e1ae1f634548c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.583176:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dd510e/0x419e1ae1f634548c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.583183:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079dd510e/0x419e1ae1f634548c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.583254:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587430.583709:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587430.583716:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085810448/0x419e1ae1f6345493 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.583726:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=628s v=(0 0) 00010000:00010000:1.0:1788587430.583730:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587430.583735:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085810448/0x419e1ae1f6345493 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.583746:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085810448/0x419e1ae1f6345493 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.583765:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085810448/0x419e1ae1f6345493 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.583772:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085810448/0x419e1ae1f6345493 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.584276:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587430.584285:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079dd510e/0x419e1ae1f634548c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.584293:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.584298:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd510e/0x419e1ae1f634548c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.584308:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dd510e/0x419e1ae1f634548c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.584325:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079dd510e/0x419e1ae1f634548c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.584333:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079dd510e/0x419e1ae1f634548c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.584355:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.584358:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085810448/0x419e1ae1f6345493 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.584364:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.584374:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085810448/0x419e1ae1f6345493 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.584382:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085810448/0x419e1ae1f6345493 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.584391:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085810448/0x419e1ae1f6345493 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.584399:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.584400:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.584402:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.584602:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587430.584609:0:23265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085810448/0x419e1ae1f6345493 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.584637:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587430.587225:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587430.587239:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634549a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.587256:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788587430.587261:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587430.587268:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634549a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.587298:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634549a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.587309:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634549a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.587317:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634549a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.587339:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.587367:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.587375:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634549a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.587384:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fa00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.587390:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634549a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.587400:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634549a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.587430:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634549a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.587440:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.587447:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.587449:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587430.587472:0:23265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373748ac/0x419e1ae1f634549a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587430.588440:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587430.588447:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f63454a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.588460:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788587430.588475:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587430.588481:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f63454a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.588491:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f63454a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.588510:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f63454a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.588517:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f63454a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.588541:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.588632:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.588642:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f63454a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.588652:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.588655:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f63454a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.588665:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f63454a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.588679:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f63454a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.588687:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c414b984/0x419e1ae1f63454a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.588704:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.588706:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.588708:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587430.589502:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587430.589509:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f63454a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.589521:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788587430.589525:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587430.589530:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f63454a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.589542:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f63454a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.589550:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f63454a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.589557:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f63454a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.589595:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.589789:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.589812:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f63454a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.589821:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.589825:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f63454a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.589841:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f63454a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.589855:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f63454a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.589862:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082cc36c4/0x419e1ae1f63454a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.589876:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.589877:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.589879:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587430.590664:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587430.590927:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000204bfeb8/0x419e1ae1f63454af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.590941:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788587430.591016:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587430.591023:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000204bfeb8/0x419e1ae1f63454af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.591037:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000204bfeb8/0x419e1ae1f63454af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.591047:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000204bfeb8/0x419e1ae1f63454af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.591055:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000204bfeb8/0x419e1ae1f63454af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.591081:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587430.591112:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587430.591120:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000204bfeb8/0x419e1ae1f63454af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.591128:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587430.591133:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000204bfeb8/0x419e1ae1f63454af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.591142:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000204bfeb8/0x419e1ae1f63454af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.591157:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000204bfeb8/0x419e1ae1f63454af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.591165:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000204bfeb8/0x419e1ae1f63454af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.591183:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.591185:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.591187:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587430.591654:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587430.591660:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e09d9c6c/0x419e1ae1f63454b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.592501:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788587430.592513:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587430.592521:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e09d9c6c/0x419e1ae1f63454b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.592534:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e09d9c6c/0x419e1ae1f63454b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.592543:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e09d9c6c/0x419e1ae1f63454b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.592550:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e09d9c6c/0x419e1ae1f63454b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.592566:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.592790:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.592825:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e09d9c6c/0x419e1ae1f63454b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.592835:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.592841:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e09d9c6c/0x419e1ae1f63454b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.592850:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e09d9c6c/0x419e1ae1f63454b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.592867:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e09d9c6c/0x419e1ae1f63454b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.592888:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e09d9c6c/0x419e1ae1f63454b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.592907:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.592914:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.592916:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587430.593278:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587430.593286:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f63454bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.593296:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788587430.593299:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587430.593304:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f63454bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.593315:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f63454bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.593325:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f63454bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.593339:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f63454bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.593647:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788587430.594536:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587430.594544:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed9b05cf/0x419e1ae1f63454c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.594559:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788587430.594563:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587430.594569:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed9b05cf/0x419e1ae1f63454c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.594580:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed9b05cf/0x419e1ae1f63454c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.594590:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed9b05cf/0x419e1ae1f63454c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.594597:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed9b05cf/0x419e1ae1f63454c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.594620:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587430.595400:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587430.595409:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f63454bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.595418:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499f600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587430.595423:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f63454bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.595434:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f63454bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.595452:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f63454bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.595461:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f55c984/0x419e1ae1f63454bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.595494:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587430.595498:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed9b05cf/0x419e1ae1f63454c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587430.595576:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587430.595583:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8323b52/0x419e1ae1f63454cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.595598:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788587430.595603:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587430.595608:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8323b52/0x419e1ae1f63454cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.595618:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8323b52/0x419e1ae1f63454cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.595626:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8323b52/0x419e1ae1f63454cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.595634:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8323b52/0x419e1ae1f63454cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.595643:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587430.596212:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ec00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587430.596218:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed9b05cf/0x419e1ae1f63454c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.596229:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed9b05cf/0x419e1ae1f63454c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.596254:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed9b05cf/0x419e1ae1f63454c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.596262:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed9b05cf/0x419e1ae1f63454c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.596283:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587430.596287:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8323b52/0x419e1ae1f63454cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.596293:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499fe00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587430.596296:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8323b52/0x419e1ae1f63454cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.596304:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8323b52/0x419e1ae1f63454cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.596315:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8323b52/0x419e1ae1f63454cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.596322:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8323b52/0x419e1ae1f63454cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.596339:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.596341:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.596349:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587430.596511:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587430.596516:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f63454d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.596525:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=628s v=(0 0) 00010000:00010000:0.0:1788587430.596529:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587430.596533:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f63454d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.596542:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f63454d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.596560:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f63454d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.596566:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f63454d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.596579:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.596669:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.596676:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f63454d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.596684:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.596689:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f63454d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.596698:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f63454d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.596711:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f63454d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.596718:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ede57622/0x419e1ae1f63454d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.596735:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.596738:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.596740:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.596965:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587430.603677:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587430.603691:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f63454d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.603708:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788587430.603712:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587430.603719:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f63454d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.603734:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f63454d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.603744:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f63454d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.603752:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f63454d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.603776:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587430.604324:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587430.604332:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f63454d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.604352:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587430.604358:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f63454d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.604367:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f63454d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.604384:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f63454d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.604391:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f63454d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.604407:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587430.604415:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587430.604418:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587430.605525:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587430.605535:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63454e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.605549:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788587430.605553:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587430.605559:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63454e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.605583:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63454e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.605592:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63454e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.605599:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63454e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.605621:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587430.605645:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587430.605653:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63454e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.605664:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c18000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587430.605669:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63454e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.605679:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63454e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.605696:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63454e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.605704:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63454e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.605725:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.605727:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.605729:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587430.607969:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587430.607981:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aa51724/0x419e1ae1f63454e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.607997:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788587430.608001:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587430.608008:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aa51724/0x419e1ae1f63454e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.608021:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aa51724/0x419e1ae1f63454e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.608031:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aa51724/0x419e1ae1f63454e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.608050:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aa51724/0x419e1ae1f63454e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.608074:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587430.608434:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587430.608442:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aa51724/0x419e1ae1f63454e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.608451:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587430.608455:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aa51724/0x419e1ae1f63454e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.608475:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aa51724/0x419e1ae1f63454e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.608494:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aa51724/0x419e1ae1f63454e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.608503:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aa51724/0x419e1ae1f63454e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.608520:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587430.608522:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587430.608524:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587430.612873:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587430.612886:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c755b/0x419e1ae1f63454ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.612903:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788587430.612908:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587430.612914:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c755b/0x419e1ae1f63454ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.612928:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa2c755b/0x419e1ae1f63454ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.612939:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa2c755b/0x419e1ae1f63454ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.612947:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa2c755b/0x419e1ae1f63454ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.612971:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587430.613089:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587430.613097:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa2c755b/0x419e1ae1f63454ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.613104:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19c00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587430.613109:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c755b/0x419e1ae1f63454ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.613124:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa2c755b/0x419e1ae1f63454ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.613143:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa2c755b/0x419e1ae1f63454ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.613151:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa2c755b/0x419e1ae1f63454ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.613169:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.613171:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.613172:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587430.615486:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587430.615564:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de98c916/0x419e1ae1f63454f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.615590:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788587430.615594:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587430.615601:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de98c916/0x419e1ae1f63454f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.615616:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de98c916/0x419e1ae1f63454f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.615627:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de98c916/0x419e1ae1f63454f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.615635:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de98c916/0x419e1ae1f63454f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.615720:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587430.615737:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587430.615742:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de98c916/0x419e1ae1f63454f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.615750:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c18a00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587430.615755:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de98c916/0x419e1ae1f63454f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.615764:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de98c916/0x419e1ae1f63454f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.615811:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de98c916/0x419e1ae1f63454f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.615820:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de98c916/0x419e1ae1f63454f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.615839:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.615840:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.615842:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587430.616652:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587430.616723:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077eba68f/0x419e1ae1f63454fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.616735:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788587430.616739:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587430.616745:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077eba68f/0x419e1ae1f63454fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.616756:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077eba68f/0x419e1ae1f63454fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.616765:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077eba68f/0x419e1ae1f63454fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.616775:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077eba68f/0x419e1ae1f63454fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.616821:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587430.616840:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587430.616848:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077eba68f/0x419e1ae1f63454fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.616859:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587430.616864:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077eba68f/0x419e1ae1f63454fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.616873:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077eba68f/0x419e1ae1f63454fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.616890:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077eba68f/0x419e1ae1f63454fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.616913:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077eba68f/0x419e1ae1f63454fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587430.616934:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.616937:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587430.616938:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587430.617441:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587430.617448:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000982bd32a/0x419e1ae1f6345503 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.617459:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788587430.617475:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587430.617480:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000982bd32a/0x419e1ae1f6345503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.617555:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000982bd32a/0x419e1ae1f6345503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.617565:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000982bd32a/0x419e1ae1f6345503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.617574:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000982bd32a/0x419e1ae1f6345503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.617633:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587430.618398:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587430.618406:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000794bcea7/0x419e1ae1f634550a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.618424:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788587430.618434:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587430.618439:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000794bcea7/0x419e1ae1f634550a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.618450:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000794bcea7/0x419e1ae1f634550a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.618459:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000794bcea7/0x419e1ae1f634550a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.618475:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000794bcea7/0x419e1ae1f634550a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.618816:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587430.618824:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000982bd32a/0x419e1ae1f6345503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.618832:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c18400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587430.618837:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000982bd32a/0x419e1ae1f6345503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.618854:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000982bd32a/0x419e1ae1f6345503 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.618869:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000982bd32a/0x419e1ae1f6345503 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.618876:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000982bd32a/0x419e1ae1f6345503 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.618894:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587430.618898:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000794bcea7/0x419e1ae1f634550a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.618904:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587430.618907:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000794bcea7/0x419e1ae1f634550a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.618913:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000794bcea7/0x419e1ae1f634550a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.618921:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000794bcea7/0x419e1ae1f634550a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.618928:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587430.618929:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587430.618937:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.619008:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788587430.619014:0:23265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000794bcea7/0x419e1ae1f634550a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.619574:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587430.620421:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587430.620431:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbbbd2c/0x419e1ae1f6345511 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.620444:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788587430.620448:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587430.620453:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bbbbd2c/0x419e1ae1f6345511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.620478:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bbbbd2c/0x419e1ae1f6345511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.620571:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bbbbd2c/0x419e1ae1f6345511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.620582:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bbbbd2c/0x419e1ae1f6345511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.620634:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587430.621098:0:23265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587430.621105:0:23265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6345518 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.621114:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=628s v=(0 0) 00010000:00010000:2.0:1788587430.621117:0:23265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587430.621122:0:23265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6345518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.621148:0:23265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6345518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.621156:0:23265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6345518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587430.621164:0:23265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6345518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.621384:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587430.621392:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bbbbd2c/0x419e1ae1f6345511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.621400:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587430.621404:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbbbd2c/0x419e1ae1f6345511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.621414:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bbbbd2c/0x419e1ae1f6345511 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.621430:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bbbbd2c/0x419e1ae1f6345511 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.621438:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bbbbd2c/0x419e1ae1f6345511 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.621457:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587430.621460:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6345518 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.621476:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42045200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587430.621479:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6345518 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.621508:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6345518 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.621519:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6345518 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587430.621527:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587430.621529:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587430.621531:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587430.621634:0:23265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788587430.621640:0:23265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b58f58b6/0x419e1ae1f6345518 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788587430.621865:0:23265:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:2.0:1788587430.621952:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:21980:x1875469310081152:12345-0@lo:5:osp-pre-0-0.0 Request processed in 102295us (102395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587430.621973:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788587430.622093:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587430.623010:0:21980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21980:1875469310081152:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788587430.623029:0:21980:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1788587430.623081:0:21980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21980:1875469310081280:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788587430.623125:0:21980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587430.623157:0:21980:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf270eaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587430.623323:0:23267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310081280 00000100:00100000:1.0:1788587430.623342:0:23267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310081280 00000100:00100000:1.0:1788587430.623387:0:23267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587430.623396:0:23267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:21980:x1875469310081280:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788587430.625057:0:23267:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000100:00100000:1.0:1788587430.632059:0:23267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:21980:x1875469310081280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8657us (8926us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788587430.632072:0:23267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587430.632102:0:21980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:21980:1875469310081280:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788587430.632119:0:21980:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1788587431.146986:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788587431.276331:0:21952:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788587431.276339:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf02a84800 from 13 10000000:01000000:3.0:1788587431.276345:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788587431.276389:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.276402:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.276425:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587431.276451:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310081408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587431.276531:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587431.276570:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587431.276590:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310081408 00000100:00100000:3.0:1788587431.276596:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310081408 00000100:00100000:3.0:1788587431.276645:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788587431.276653:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+19:21952:x1875469310081408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587431.276666:0:21949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587431.276679:0:21949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27200/0x419e1ae1f6345526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634551f expref: -99 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.276701:0:21949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27200/0x419e1ae1f6345526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634551f expref: 20 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.276712:0:21949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27200/0x419e1ae1f6345526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634551f expref: 20 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.276720:0:21949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27200, rc 0) 00000100:00100000:3.0:1788587431.276754:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:21952:x1875469310081408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587431.276761:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788587431.276834:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310081408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587431.276849:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.276865:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587431.276911:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310081536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788587431.276942:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587431.276957:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587431.276970:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310081536 00000100:00100000:3.0:1788587431.276973:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310081536 00000100:00100000:3.0:1788587431.276996:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788587431.277002:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:21952:x1875469310081536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788587431.277016:0:21948:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788587431.277032:0:21948:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788587431.277036:0:21948:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788587431.277110:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:21952:x1875469310081536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587431.277118:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788587431.277148:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310081536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788587431.277207:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587431.277214:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.277223:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587431.277232:0:21952:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788587431.277234:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf3b397800 from 13 10000000:01000000:3.0:1788587431.277242:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788587431.277258:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.277264:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.277271:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587431.277283:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310081664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587431.277307:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587431.277321:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf087e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587431.277332:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310081664 00000100:00100000:3.0:1788587431.277335:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310081664 00000100:00100000:3.0:1788587431.277355:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788587431.277361:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:21952:x1875469310081664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587431.277369:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587431.277377:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f26200/0x419e1ae1f6345534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634552d expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.277391:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f26200/0x419e1ae1f6345534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634552d expref: 21 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.277399:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f26200/0x419e1ae1f6345534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634552d expref: 21 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.277406:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26200, rc 0) 00000100:00100000:3.0:1788587431.277433:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:21952:x1875469310081664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587431.277447:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788587431.277490:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310081664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587431.277500:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.277508:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587431.277544:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310081792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788587431.277569:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587431.277581:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf34833cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587431.277591:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310081792 00000100:00100000:3.0:1788587431.277594:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310081792 00000100:00100000:3.0:1788587431.277613:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788587431.277619:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:21952:x1875469310081792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788587431.277629:0:21948:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788587431.277640:0:21948:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788587431.277643:0:21948:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788587431.277704:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:21952:x1875469310081792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 84us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587431.277710:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788587431.277738:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310081792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788587431.277773:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587431.277779:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587431.277817:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587432.175494:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587432.492994:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310081920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587432.493064:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587432.493763:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310081920 00000100:00100000:0.0:1788587432.493772:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310081920 00000100:00100000:0.0:1788587432.493847:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587432.493856:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310081920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587432.493892:0:21960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587432.493944:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310081920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587432.493951:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587432.494573:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310081920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587432.494602:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310082048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587432.494638:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587432.494759:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310082048 00000100:00100000:3.0:1788587432.494764:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310082048 00000100:00100000:3.0:1788587432.494863:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587432.494871:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310082048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788587432.494894:0:21961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587432.494933:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310082048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587432.494939:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587432.495021:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310082048:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788587433.196015:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587434.222343:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788587435.153519:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1788587435.153568:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788587435.246871:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587435.375038:0:23633:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788587435.563711:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310082176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587435.563782:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788587435.563974:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587435.563977:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788587435.563980:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587435.563986:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 628 00000100:00080000:2.0:1788587435.563991:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788587435.563996:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10d7a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587435.564029:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf07c2dc00 x1875469310082560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587435.564065:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587435.564068:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587435.564071:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587435.564074:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587435.564105:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310082432:0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.564136:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587435.564162:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469310083072:0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.564186:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587435.564203:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788587435.564208:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3475:1875469310082304:0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.564233:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587435.564255:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310082944:0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.564276:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587435.564301:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310082560:0@lo:8:kworker.0 00000100:00100000:2.0:1788587435.564329:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587435.564358:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310082432 00000100:00100000:2.0:1788587435.564365:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310082432 00000100:00100000:2.0:1788587435.564410:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587435.564420:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310082432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.564481:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310082432:12345-0@lo:400:kworker.0 Request processed in 62us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587435.564488:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587435.564518:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310083072 00000100:00100000:2.0:1788587435.564522:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310083072 00000100:00100000:2.0:1788587435.564555:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310082944 00000100:00100000:2.0:1788587435.564558:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310082944 00000100:00100000:2.0:1788587435.564570:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587435.564576:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469310083072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.564604:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3475:x1875469310083072:12345-0@lo:400:kworker.0 Request processed in 28us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587435.564610:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587435.564619:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587435.564625:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310082944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.564648:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310082944:12345-0@lo:400:kworker.0 Request processed in 23us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587435.564653:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587435.564668:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310082304 00000100:00100000:2.0:1788587435.564671:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310082304 00000100:00100000:2.0:1788587435.564693:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788587435.564700:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:3475:x1875469310082304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.564727:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:3475:x1875469310082304:12345-0@lo:400:kworker.0 Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587435.564734:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788587435.564759:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310082560 00000100:00100000:2.0:1788587435.564763:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310082560 00000100:00100000:2.0:1788587435.564782:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587435.564787:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310082560:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788587435.564829:0:23265:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788587435.564862:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10947b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310082560:12345-0@lo:8:kworker.0 Request processed in 74us (531us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788587435.564876:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788587435.564895:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587435.564916:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310082688:0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.564942:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587435.564960:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310083200:0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.564980:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587435.564995:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587435.565001:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310082816:0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.565022:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587435.565047:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310082816 00000100:00100000:2.0:1788587435.565051:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310082816 00000100:00100000:2.0:1788587435.565072:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587435.565078:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310082816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.565112:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310082816:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587435.565118:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587435.565132:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310082688 00000100:00100000:2.0:1788587435.565135:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310082688 00000100:00100000:2.0:1788587435.565149:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310083200 00000100:00100000:2.0:1788587435.565151:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310083200 00000100:00100000:2.0:1788587435.565168:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587435.565173:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310082688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.565201:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310082688:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587435.565207:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587435.565217:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587435.565231:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310083200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.565259:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310083200:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587435.565264:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788587435.565277:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587435.565301:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587435.565306:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788587435.565310:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310082560:0@lo:8:kworker.0 00000100:00100000:2.0:1788587435.565337:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310082816:0@lo:400:kworker.0 00010000:00080000:2.0:1788587435.565348:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf07c2ce00 x1875469310082688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587435.565358:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310082688:0@lo:400:kworker.0 00010000:00080000:2.0:1788587435.565367:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf07c2c700 x1875469310083200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587435.565376:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310083200:0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.565411:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3475:1875469310082304:0@lo:400:kworker.0 00010000:00080000:2.0:1788587435.565421:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf07c2ea00 x1875469310082944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587435.565441:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310082944:0@lo:400:kworker.0 00000100:00100000:2.0:1788587435.565452:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310082432:0@lo:400:kworker.0 00010000:00080000:2.0:1788587435.565461:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf07c2fb80 x1875469310083072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587435.565481:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3475:1875469310083072:0@lo:400:kworker.0 00000100:00100000:0.0:1788587435.568835:0:23269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310082176 00000100:00100000:0.0:1788587435.568850:0:23269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310082176 00000100:00100000:0.0:1788587435.568912:0:23269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587435.568922:0:23269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310082176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587435.568954:0:23269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788587435.569025:0:23269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310082176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (5244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587435.569032:0:23269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587435.569089:0:3473:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788587435.569111:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310082176:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788587435.576013:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788587436.269323:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587437.291775:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587437.611588:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310083328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587437.611656:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587437.611703:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310083456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587437.611736:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587437.611779:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310083328 00000100:00100000:0.0:1788587437.611788:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310083328 00000100:00100000:0.0:1788587437.611853:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310083456 00000100:00100000:0.0:1788587437.611857:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310083456 00000100:00100000:0.0:1788587437.611874:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587437.611883:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310083328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587437.611920:0:21960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587437.611969:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310083328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587437.611977:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587437.611999:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587437.612005:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310083456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587437.612024:0:21960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587437.612055:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310083456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587437.612062:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587437.612107:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310083456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587437.612143:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310083328:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788587437.612888:0:21990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788587438.316005:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587439.340448:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587439.724608:0:22612:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788587440.363335:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587440.684117:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310083584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587440.684184:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587440.684262:0:23269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310083584 00000100:00100000:0.0:1788587440.684269:0:23269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310083584 00000100:00100000:0.0:1788587440.684322:0:23269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587440.684331:0:23269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310083584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587440.684366:0:23269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788587440.684421:0:23269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310083584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587440.684428:0:23269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788587440.684476:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587440.684513:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310083584:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788587440.685382:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587440.685387:0:19211:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788587440.685390:0:19211:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587440.685404:0:19211:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:0.0:1788587440.685407:0:19211:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788587440.685413:0:19211:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10d7a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587440.685430:0:19211:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe03da0000 x1875469310083968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587440.685461:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587440.685465:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587440.685467:0:19211:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587440.685481:0:19211:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788587440.685534:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310083712:0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.685575:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587440.685601:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310084352:0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.685833:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587440.685854:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788587440.685859:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310083840:0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.685880:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587440.685895:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310084480:0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.685912:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587440.686070:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310083712 00000100:00100000:0.0:1788587440.686076:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310083712 00000100:00100000:0.0:1788587440.686107:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788587440.686115:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:3472:x1875469310083712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.686155:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:3472:x1875469310083712:12345-0@lo:400:kworker.0 Request processed in 40us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587440.686161:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788587440.686186:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310083840 00000100:00100000:0.0:1788587440.686189:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310083840 00000100:00100000:0.0:1788587440.686209:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587440.686214:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310083840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.686242:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310083840:12345-0@lo:400:kworker.0 Request processed in 28us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587440.686248:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587440.686265:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310084096:0@lo:400:kworker.0 00000100:00100000:3.0:1788587440.687135:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310084352 00000100:00100000:3.0:1788587440.687144:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310084352 00000100:00100000:3.0:1788587440.687174:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310084480 00000100:00100000:3.0:1788587440.687176:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310084480 00000100:00100000:3.0:1788587440.687197:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587440.687203:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310084352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587440.687252:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310084352:12345-0@lo:400:kworker.0 Request processed in 49us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587440.687269:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587440.687407:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310083968:0@lo:8:kworker.0 00000100:00100000:0.0:1788587440.687434:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587440.687719:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788587440.687726:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310084480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587440.687756:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310084480:12345-0@lo:400:kworker.0 Request processed in 31us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587440.687761:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788587440.687782:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587440.687825:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310083968 00000100:00100000:3.0:1788587440.687829:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310083968 00000100:00100000:3.0:1788587440.687847:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587440.687851:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310083968:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788587440.687871:0:23265:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788587440.688440:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310084224:0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.688477:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587440.688922:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310084224 00000100:00100000:0.0:1788587440.688928:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310084224 00000100:00100000:0.0:1788587440.688961:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587440.688968:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310084224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.689379:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310084224:12345-0@lo:400:kworker.0 Request processed in 410us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587440.689387:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587440.689439:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310084224:0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.689474:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310083840:0@lo:400:kworker.0 00010000:00080000:0.0:1788587440.689500:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe03da2680 x1875469310084480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587440.689512:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310084480:0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.689524:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310083712:0@lo:400:kworker.0 00010000:00080000:0.0:1788587440.689535:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe03da1880 x1875469310084352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587440.689544:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310084352:0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.693243:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587440.694144:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310084096 00000100:00100000:1.0:1788587440.694155:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310084096 00000100:00100000:1.0:1788587440.694208:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587440.694287:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310084096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587440.694353:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310084096:12345-0@lo:400:kworker.0 Request processed in 136us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587440.694361:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788587440.695868:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe03da0700 x1875469310084096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587440.695902:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310084096:0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.695913:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310084608:0@lo:400:kworker.0 00000100:00100000:0.0:1788587440.695965:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587440.696429:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310084608 00000100:00100000:1.0:1788587440.696436:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310084608 00000100:00080000:0.0:1788587440.696495:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788587440.696503:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587440.696512:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310084608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587440.696582:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3474:x1875469310084608:12345-0@lo:400:kworker.0 Request processed in 71us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587440.696589:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788587440.696835:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe03da0380 x1875469310084608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587440.696846:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3474:1875469310084608:0@lo:400:kworker.0 00000100:00100000:3.0:1788587440.725945:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310083968:12345-0@lo:8:kworker.0 Request processed in 38083us (38500us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587440.725959:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788587440.726349:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587440.726355:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587440.726359:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310083968:0@lo:8:kworker.0 00010000:00010000:3.0:1788587441.387026:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788587441.817285:0:23983:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788587441.817289:0:23983:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788587441.817487:0:23983:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbf04665800 00000020:01000004:2.0:1788587441.817503:0:23983:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788587441.817517:0:23983:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788587441.817533:0:23983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cbf181a0000) 00000020:00000080:2.0:1788587441.817552:0:23983:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788587441.834605:0:23983:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788587441.835073:0:23983:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788587441.837159:0:23983:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788587441.837790:0:23983:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788587441.838227:0:23983:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788587441.838704:0:23983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 617: rc = 0 00100000:10000000:2.0:1788587441.838959:0:23983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 617: rc = 0 00100000:10000000:2.0:1788587441.839067:0:23983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 617: rc = 0 00100000:10000000:2.0:1788587441.839651:0:23983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1788587441.840218:0:23983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1788587441.840570:0:23983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788587441.841138:0:23983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1788587441.841478:0:23983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:3.0:1788587441.841764:0:23983:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:3.0:1788587441.842490:0:23983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788587441.842504:0:23983:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788587441.842515:0:23983:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x419e1ae1f6345542 00000020:01000004:3.0:1788587441.842523:0:23983:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788587441.842544:0:23983:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788587441.842547:0:23983:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788587441.842552:0:23983:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788587441.842571:0:23983:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788587441.842580:0:23983:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788587441.851062:0:23983:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788587441.851105:0:23983:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.114@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788587441.851109:0:23983:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788587441.851111:0:23983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587441.851112:0:23983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587441.851113:0:23983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587441.851115:0:23983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587441.851116:0:23983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587441.851117:0:23983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587441.851119:0:23983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587441.851121:0:23983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587441.851126:0:23983:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788587441.851128:0:23983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788587441.851129:0:23983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587441.851131:0:23983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587441.851132:0:23983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587441.851133:0:23983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587441.851135:0:23983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587441.851136:0:23983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587441.851137:0:23983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587441.851138:0:23983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788587441.851176:0:23983:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788587441.851197:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310084736:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788587441.851275:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587441.852038:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587441.852121:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310084736 00000100:00100000:2.0:1788587441.852130:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310084736 00000100:00100000:2.0:1788587441.852225:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788587441.852235:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23983:x1875469310084736:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788587441.852295:0:21949:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788587441.852298:0:21949:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788587441.852302:0:21949:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788587441.858822:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23983:x1875469310084736:12345-0@lo:253:mount.lustre.0 Request processed in 6557us (7515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587441.858836:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788587441.859075:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310084736:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788587441.859092:0:23983:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788587441.859095:0:23983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788587441.859097:0:23983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788587441.859098:0:23983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788587441.859100:0:23983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788587441.859101:0:23983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788587441.859102:0:23983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788587441.859104:0:23983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788587441.859105:0:23983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788587441.859121:0:23983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788587441.859144:0:23983:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbf04665800 from lustre-OST0001 10000000:01000000:3.0:1788587441.859172:0:23983:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788587441.859175:0:23983:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788587441.859185:0:23983:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbf053ab380 local copy 00010000:00010000:3.0:1788587441.859197:0:23983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587441.860066:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310084864:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587441.860119:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587441.860212:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587441.860262:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310084864 00000100:00100000:2.0:1788587441.860269:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310084864 00000100:00100000:2.0:1788587441.860419:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788587441.860430:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23983:x1875469310084864:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587441.860629:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23983:x1875469310084864:12345-0@lo:501:mount.lustre.0 Request processed in 200us (508us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587441.860637:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788587441.860714:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310084864:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788587441.860734:0:23983:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788587441.860924:0:23983:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788587441.860934:0:23983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587441.860944:0:23983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18600/0x419e1ae1f6345183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634518a expref: -99 pid: 21937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587441.860969:0:23983:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbf04665800 10000000:01000000:3.0:1788587441.860974:0:23983:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788587441.860979:0:23983:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788587441.860982:0:23983:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587441.860986:0:23983:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788587441.860989:0:23983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788587441.861014:0:23983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26000/0x419e1ae1f6345549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587441.861022:0:23983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26000/0x419e1ae1f6345549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587441.861038:0:23983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26000/0x419e1ae1f6345549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587441.861054:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310084992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587441.861083:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587441.861356:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36e6ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587441.861468:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310084992 00000100:00100000:0.0:1788587441.861475:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310084992 00000100:00100000:0.0:1788587441.861505:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788587441.861513:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:23983:x1875469310084992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587441.861524:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587441.861537:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6345550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345549 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587441.861558:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6345550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345549 expref: 22 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587441.861568:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499f800/0x419e1ae1f6345550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345549 expref: 22 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587441.861577:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f800, rc 0) 00000100:00100000:0.0:1788587441.861681:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:23983:x1875469310084992:12345-0@lo:101:mount.lustre.0 Request processed in 168us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587441.861688:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788587441.861836:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310084992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587441.861947:0:23983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26000/0x419e1ae1f6345549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345550 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587441.861957:0:23983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26000/0x419e1ae1f6345549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345550 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587441.863448:0:23983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788587441.864753:0:23983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587441.865135:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788587441.865184:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788587441.865220:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788587441.865269:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788587441.865306:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788587441.865340:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788587441.865399:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788587441.865439:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788587441.865487:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788587441.865544:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788587441.865551:0:23983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1788587441.865710:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587441.865787:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587441.865936:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10d4bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587441.866011:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310085120 00000100:00100000:1.0:1788587441.866018:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310085120 00000100:00100000:1.0:1788587441.866065:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788587441.866076:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:23983:x1875469310085120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587441.866452:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:23983:x1875469310085120:12345-0@lo:501:mount.lustre.0 Request processed in 377us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587441.866460:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788587441.866596:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587441.866650:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587441.866696:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587441.866718:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf10d4bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587441.866984:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310085248 00000100:00100000:1.0:1788587441.866989:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310085248 00000100:00100000:1.0:1788587441.867071:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788587441.867079:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:23983:x1875469310085248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587441.867398:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:23983:x1875469310085248:12345-0@lo:503:mount.lustre.0 Request processed in 310us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587441.867405:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788587441.867470:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085248:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788587441.868175:0:23983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587441.868249:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587441.868304:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587441.868449:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1ea9eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587441.868520:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310085376 00000100:00100000:2.0:1788587441.868526:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310085376 00000100:00100000:2.0:1788587441.868554:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788587441.868562:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:23983:x1875469310085376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587441.868959:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085376:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587441.869210:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788587441.869257:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788587441.869292:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788587441.869358:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788587441.869407:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788587441.869440:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788587441.869486:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788587441.869520:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788587441.869566:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788587441.869597:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587441.869710:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587441.869732:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1ea9eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587441.869842:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:23983:x1875469310085376:12345-0@lo:502:mount.lustre.0 Request processed in 284us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587441.869925:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788587441.869961:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310085504 00000100:00100000:2.0:1788587441.869968:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310085504 00000100:00100000:2.0:1788587441.869990:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788587441.869997:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:23983:x1875469310085504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587441.870146:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:23983:x1875469310085504:12345-0@lo:502:mount.lustre.0 Request processed in 149us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587441.870163:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788587441.870505:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587441.870581:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788587441.870591:0:23983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788587441.871714:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788587441.871723:0:23984:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788587441.871729:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.871731:0:23984:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788587441.871737:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587441.871752:0:23984:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cbe044f19c0) 00000020:00000080:3.0:1788587441.871774:0:23984:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788587441.871778:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788587441.872981:0:23984:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf04665800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788587441.872994:0:23984:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788587441.873003:0:23984:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x419e1ae1f634555e 00010000:00010000:3.0:1788587441.877567:0:23984:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788587441.878588:0:23984:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1788587441.880773:0:23984:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1788587441.882501:0:23984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788587441.882514:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587441.882520:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.882522:0:23984:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788587441.882526:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587441.882530:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.882532:0:23984:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788587441.882536:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788587441.882538:0:23984:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788587441.882540:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587441.882543:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.882544:0:23984:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788587441.882547:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587441.882549:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.882551:0:23984:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788587441.882554:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788587441.882775:0:23984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587441.882780:0:23984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.882782:0:23984:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788587441.882842:0:23984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788587441.883098:0:23983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788587441.883128:0:23983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788587441.883148:0:23983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26000/0x419e1ae1f6345549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345550 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587441.883160:0:23983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26000/0x419e1ae1f6345549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345550 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587441.883167:0:23983:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf04665800 from 1 10000000:01000000:2.0:1788587441.883169:0:23983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587441.883215:0:23983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587441.883223:0:23983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587441.883234:0:23983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587441.883258:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587441.883320:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587441.883363:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf084f8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587441.883438:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310085632 00000100:00100000:1.0:1788587441.883445:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310085632 00000100:00100000:1.0:1788587441.883494:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788587441.883505:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:23983:x1875469310085632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587441.883517:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587441.883538:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f634556c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345565 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587441.883562:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f634556c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345565 expref: 23 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587441.883574:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f634556c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345565 expref: 23 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587441.883583:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cce00, rc 0) 00000100:00100000:1.0:1788587441.883637:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:23983:x1875469310085632:12345-0@lo:101:mount.lustre.0 Request processed in 134us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587441.883644:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788587441.883967:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587441.883984:0:23983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587441.883994:0:23983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587441.884535:0:23983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788587441.885481:0:23983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587441.885976:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788587441.886024:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788587441.886075:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788587441.886116:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788587441.886170:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788587441.886378:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788587441.886429:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788587441.886462:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788587441.886524:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788587441.886564:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788587441.886599:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788587441.888162:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788587441.888171:0:23983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788587441.888280:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587441.888346:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587441.888408:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf084f8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587441.888524:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310085760 00000100:00100000:3.0:1788587441.888532:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310085760 00000100:00100000:3.0:1788587441.888585:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788587441.888594:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3438d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:23983:x1875469310085760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587441.889033:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587441.889071:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587441.889119:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3438d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:23983:x1875469310085760:12345-0@lo:501:mount.lustre.0 Request processed in 525us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587441.889128:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788587441.889348:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587441.889381:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf084f8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587441.889437:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310085888 00000100:00100000:3.0:1788587441.889442:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310085888 00000100:00100000:3.0:1788587441.889476:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788587441.889484:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3438e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:23983:x1875469310085888:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587441.889670:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3438e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:23983:x1875469310085888:12345-0@lo:503:mount.lustre.0 Request processed in 186us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587441.889677:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788587441.895027:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310085888:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788587441.897550:0:23983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587441.898329:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587441.898415:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587441.898463:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587441.898530:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310086016 00000100:00100000:2.0:1788587441.898537:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310086016 00000100:00100000:2.0:1788587441.898586:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788587441.898596:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3438dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:23983:x1875469310086016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587441.899010:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3438dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:23983:x1875469310086016:12345-0@lo:502:mount.lustre.0 Request processed in 414us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587441.899035:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788587441.899125:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788587441.900179:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788587441.900469:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788587441.900706:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788587441.900750:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788587441.900782:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788587441.901345:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788587441.901397:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788587441.901436:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788587441.901487:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788587441.901527:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788587441.901562:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788587441.902704:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587441.902790:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587441.903041:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf343b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587441.904686:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310086144 00000100:00100000:2.0:1788587441.904698:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310086144 00000100:00100000:2.0:1788587441.904815:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788587441.904826:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:23983:x1875469310086144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587441.905250:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:23983:x1875469310086144:12345-0@lo:502:mount.lustre.0 Request processed in 424us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587441.905258:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788587441.905539:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587441.905772:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788587441.905789:0:23983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788587441.907369:0:23988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587441.907380:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.907382:0:23988:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788587441.907399:0:23988:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf04665800 00000020:00000080:3.0:1788587441.907402:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587441.907412:0:23988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587441.907414:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.907415:0:23988:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788587441.907418:0:23988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587441.907420:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.907421:0:23988:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788587441.907424:0:23988:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbf04665800 00000020:00000080:3.0:1788587441.907426:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587441.907514:0:23988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587441.907518:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.907528:0:23988:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788587441.907531:0:23988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587441.907534:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.907535:0:23988:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587441.907539:0:23988:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf04665800 00000020:00000080:3.0:1788587441.907541:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587441.908349:0:23988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587441.908355:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.908357:0:23988:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587441.908360:0:23988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587441.908363:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.908364:0:23988:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788587441.908368:0:23988:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbf04665800 00000020:00000080:3.0:1788587441.908370:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587441.908438:0:23988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587441.908441:0:23988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587441.908443:0:23988:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788587441.908446:0:23988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788587441.916776:0:23983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788587441.916839:0:23983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587441.916931:0:23983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587441.916956:0:23983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587441.917011:0:23983:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788587441.917015:0:23983:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbf04665800 10000000:01000000:1.0:1788587441.917018:0:23983:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbf04665800 10000000:01000000:1.0:1788587441.917021:0:23983:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788587441.917028:0:23983:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbf04665800 from 1 10000000:01000000:1.0:1788587441.917031:0:23983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788587441.917076:0:23983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6345573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587441.917085:0:23983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6345573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587441.917097:0:23983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6345573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587441.917121:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587441.917189:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587441.917497:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf065b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587441.917906:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310086272 00000100:00100000:2.0:1788587441.917914:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310086272 00000100:00100000:2.0:1788587441.917960:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788587441.917969:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:23983:x1875469310086272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587441.917983:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587441.917996:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044a00/0x419e1ae1f634557a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345573 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587441.918021:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044a00/0x419e1ae1f634557a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345573 expref: 24 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587441.918032:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044a00/0x419e1ae1f634557a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345573 expref: 24 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587441.918042:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044a00, rc 0) 00000100:00100000:2.0:1788587441.918087:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310086272:12345-0@lo:101:mount.lustre.0 Request processed in 118us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587441.918093:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788587441.925598:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587441.925625:0:23983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6345573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634557a expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587441.925639:0:23983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6345573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f634557a expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587441.929329:0:23983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788587441.933571:0:23983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587441.936714:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788587441.936831:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788587441.938027:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788587441.938099:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788587441.938139:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788587441.938189:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788587441.941212:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788587441.941258:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788587441.941333:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788587441.941382:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788587441.941427:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788587441.941475:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788587441.941509:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788587441.941540:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788587441.941588:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788587441.941626:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788587441.941661:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788587441.941729:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788587441.941769:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788587441.941840:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788587441.941909:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788587441.941959:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788587441.941994:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788587441.942041:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788587441.942079:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788587441.942110:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788587441.942157:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788587441.942194:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788587441.942246:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788587441.942298:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788587441.942332:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788587441.942366:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788587441.942412:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788587441.942462:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788587441.942500:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788587441.942549:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788587441.942582:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788587441.942613:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788587441.942655:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788587441.942686:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788587441.942717:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788587441.942743:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788587441.942831:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788587441.942868:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788587441.942921:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788587441.942971:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788587441.943007:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788587441.943040:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788587441.943140:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788587441.943179:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788587441.943243:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788587441.943256:0:23983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788587441.943365:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587441.943442:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587441.943492:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf065b4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587441.944320:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310086400 00000100:00100000:3.0:1788587441.944332:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310086400 00000100:00100000:3.0:1788587441.944382:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788587441.944401:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310086400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587441.944661:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310086400:12345-0@lo:501:mount.lustre.0 Request processed in 261us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587441.944669:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788587441.948071:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587441.948134:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587441.949874:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587441.949929:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310086528 00000100:00100000:1.0:1788587441.949937:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310086528 00000100:00100000:1.0:1788587441.949992:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788587441.950002:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310086528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587441.950225:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310086528:12345-0@lo:503:mount.lustre.0 Request processed in 224us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587441.950236:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788587441.950289:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf065b4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587441.950315:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086528:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587441.951103:0:23983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587441.951180:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587441.951237:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587441.951271:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36f013c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587441.951591:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310086656 00000100:00100000:3.0:1788587441.951598:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310086656 00000100:00100000:3.0:1788587441.951649:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788587441.951659:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310086656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587441.952095:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310086656:12345-0@lo:502:mount.lustre.0 Request processed in 435us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587441.952109:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788587441.952195:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587441.952444:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788587441.952495:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788587441.952529:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788587441.952584:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788587441.952620:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788587441.952682:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788587441.952717:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788587441.952747:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788587441.952811:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788587441.952921:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788587441.952964:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788587441.953012:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788587441.953049:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788587441.953083:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788587441.953125:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788587441.953159:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788587441.953192:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788587441.953239:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788587441.953274:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788587441.953306:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788587441.953354:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788587441.953413:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788587441.953445:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788587441.953491:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788587441.953527:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788587441.953562:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788587441.953609:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788587441.953693:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788587441.953736:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788587441.953786:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788587441.953850:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788587441.953906:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788587441.953941:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788587441.954010:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788587441.954056:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788587441.954105:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788587441.954141:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788587441.954181:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788587441.954231:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788587441.954267:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788587441.954299:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788587441.954330:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788587441.954379:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788587441.956642:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788587441.956706:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788587441.956772:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788587441.956830:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788587441.957528:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788587441.957599:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086784:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587441.957674:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587441.957751:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587441.957790:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310086784 00000100:00100000:1.0:1788587441.958109:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310086784 00000100:00100000:1.0:1788587441.958205:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788587441.958215:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310086784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587441.958439:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310086784:12345-0@lo:502:mount.lustre.0 Request processed in 226us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587441.958447:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788587441.958488:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587441.958598:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788587441.958747:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788587441.958778:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587441.958838:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587441.958864:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1ea9eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587441.958922:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310086912 00000100:00100000:2.0:1788587441.958926:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310086912 00000100:00100000:2.0:1788587441.959010:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788587441.959018:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310086912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587441.959149:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310086912:12345-0@lo:502:mount.lustre.0 Request processed in 131us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587441.959156:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788587441.959444:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310086912:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587441.959531:0:23983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788587441.959542:0:23983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788587441.961194:0:23994:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788587441.961210:0:23994:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cbe044f3380) 00000020:00000080:3.0:1788587441.961239:0:23994:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788587441.961308:0:23994:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf04665800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788587441.961312:0:23994:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf04665800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788587441.961315:0:23994:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf04665800 3 00010000:00080000:3.0:1788587441.961345:0:23994:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf062a5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.114@tcp at head 00010000:00010000:0.0:1788587441.966441:0:23994:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788587441.966759:0:23994:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788587441.968014:0:23994:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788587441.968030:0:23994:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x419e1ae1f6345588 00000100:00080000:0.0:1788587441.968042:0:23994:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587441.968048:0:23994:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cbf062a5000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587441.968083:0:23994:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf3418b480 x1875469310087040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587441.968134:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310087040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788587441.968751:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788587441.968829:0:23994:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788587441.969018:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310087040 00000100:00100000:1.0:1788587441.969027:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310087040 00000100:00100000:1.0:1788587441.969059:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587441.969067:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3471:x1875469310087040:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788587441.969090:0:21956:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 639 last 0 00000020:00000080:1.0:1788587441.969134:0:21956:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x419e1ae1f634558f 00000004:00100000:1.0:1788587441.969150:0:21956:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788587441.970110:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587441.970115:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788587441.970118:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587441.970124:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:0.0:1788587441.970128:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788587441.970134:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10d7a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587441.970153:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf34189c00 x1875469310087424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587441.970180:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587441.970184:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587441.970186:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587441.970189:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788587441.970446:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310087168:0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.970502:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587441.970529:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310087808:0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.970554:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587441.970755:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587441.970762:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310087680:0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.970788:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587441.970993:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310087168 00000100:00100000:0.0:1788587441.971001:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310087168 00000100:00100000:3.0:1788587441.971019:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310087552:0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.971041:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310087680 00000100:00100000:0.0:1788587441.971046:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310087680 00000100:00100000:3.0:1788587441.971055:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587441.971068:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587441.971073:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469310088064:0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.971080:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310087168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587441.971098:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587441.971112:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788587441.971118:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310087296:0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.971145:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310087168:12345-0@lo:400:kworker.0 Request processed in 67us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587441.971151:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587441.971160:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587441.971179:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469310087936:0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.971183:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788587441.971206:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587441.971231:0:23267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310087296 00000100:00100000:3.0:1788587441.971235:0:23267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310087296 00000100:00100000:3.0:1788587441.971267:0:23267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587441.971273:0:23267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310087296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587441.971308:0:23267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310087296:12345-0@lo:400:kworker.0 Request processed in 35us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587441.971314:0:23267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587441.971337:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310087424:0@lo:8:kworker.0 00000100:00100000:3.0:1788587441.971359:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587441.971787:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310087424 00000100:00100000:3.0:1788587441.971813:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310087424 00000100:00100000:3.0:1788587441.971835:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587441.971841:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310087424:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788587441.971904:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3471:x1875469310087424:12345-0@lo:8:kworker.0 Request processed in 61us (543us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788587441.971911:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587441.971948:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310087296:0@lo:400:kworker.0 00000100:00100000:3.0:1788587441.971977:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788587441.972046:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587441.972051:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788587441.972055:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310087424:0@lo:8:kworker.0 00000100:00100000:0.0:1788587441.972104:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310087680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.972159:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310087680:12345-0@lo:400:kworker.0 Request processed in 966us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587441.972166:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587441.972190:0:21955:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587441.972327:0:21955:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788587441.972437:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310087680:0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.972449:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310087168:0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.972954:0:21957:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587441.972965:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310087808 00000100:00100000:0.0:1788587441.972970:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310087808 00000100:00100000:0.0:1788587441.972996:0:21957:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587441.973001:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310087552 00000100:00100000:0.0:1788587441.973003:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310087552 00000100:00100000:0.0:1788587441.973014:0:21957:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587441.973018:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310088064 00000100:00100000:0.0:1788587441.973020:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310088064 00000100:00100000:0.0:1788587441.973030:0:21957:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587441.973034:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310087936 00000100:00100000:0.0:1788587441.973046:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310087936 00000100:00100000:0.0:1788587441.973060:0:21957:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587441.973066:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587441.973072:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310087808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.973125:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310087808:12345-0@lo:400:kworker.0 Request processed in 52us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587441.973131:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587441.973144:0:21957:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587441.973150:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587441.973155:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310087552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.974455:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310087552:12345-0@lo:400:kworker.0 Request processed in 1290us (3391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587441.974467:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587441.974494:0:21957:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587441.974503:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587441.974513:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469310088064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.974568:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469310088064:12345-0@lo:400:kworker.0 Request processed in 59us (3471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587441.974574:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587441.974728:0:21957:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587441.974737:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587441.974744:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469310087936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587441.974780:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469310087936:12345-0@lo:400:kworker.0 Request processed in 36us (3574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587441.974786:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788587441.974879:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf34189180 x1875469310087936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587441.974906:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469310087936:0@lo:400:kworker.0 00010000:00080000:0.0:1788587441.974923:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf34188380 x1875469310087552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587441.974932:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310087552:0@lo:400:kworker.0 00010000:00080000:0.0:1788587441.974943:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf3418aa00 x1875469310088064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587441.974951:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469310088064:0@lo:400:kworker.0 00010000:00080000:0.0:1788587441.975002:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf34189500 x1875469310087808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587441.975011:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310087808:0@lo:400:kworker.0 00000020:01000004:0.0:1788587441.976036:0:23994:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788587441.976052:0:23994:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8cbf08788000) 00000020:00000080:0.0:1788587441.976093:0:23994:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788587441.976164:0:23994:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbf04665800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788587441.976168:0:23994:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbf04665800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788587441.976171:0:23994:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbf04665800 3 00010000:00080000:0.0:1788587441.976705:0:23994:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbf3a715000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.114@tcp at head 00000100:00080000:1.0:1788587441.978616:0:21956:0:(import.c:65:import_set_state_nolock()) ffff8cbf164fd000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1788587441.978872:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf3418b480 x1875469310087040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587441.978881:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3471:x1875469310087040:12345-0@lo:38:llog_process_th.0 Request processed in 9724us (10042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587441.978889:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1788587441.978895:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788587441.978898:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788587441.978907:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788587441.978914:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788587441.978917:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf062a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788587441.978924:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3471:1875469310087040:0@lo:38:llog_process_th.0 00010000:00010000:0.0:1788587441.981111:0:23994:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788587441.981479:0:23994:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788587441.981522:0:23994:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788587441.981535:0:23994:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x419e1ae1f634559d 00000100:00080000:0.0:1788587441.981545:0:23994:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587441.981551:0:23994:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8cbf3a715000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:0.0:1788587441.981609:0:23994:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf34189500 x1875469310088192/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587441.981640:0:23994:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788587441.981687:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587441.981691:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587441.981693:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587441.981696:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587441.985021:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3471:1875469310088192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587441.985091:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587441.985692:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310088192 00000100:00100000:0.0:1788587441.985702:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310088192 00000100:00100000:0.0:1788587441.985755:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587441.985763:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3471:x1875469310088192:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788587441.985810:0:21957:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 639 last 0 00000020:00000080:0.0:1788587441.985928:0:21957:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x419e1ae1f63455a4 00000004:00100000:0.0:1788587441.985946:0:21957:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788587441.985984:0:21957:0:(import.c:65:import_set_state_nolock()) ffff8cbf3a714000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587441.986057:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3471:x1875469310088192:12345-0@lo:38:llog_process_th.0 Request processed in 293us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587441.986064:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788587441.986113:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbf34189500 x1875469310088192/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587441.986125:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587441.986133:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788587441.986140:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788587441.986145:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788587441.986147:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf3a715000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587441.986154:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3471:1875469310088192:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788587441.988862:0:23994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788587441.988936:0:23983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788587441.988970:0:23983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587441.989036:0:23983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6345573 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634557a expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587441.989049:0:23983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421cd800/0x419e1ae1f6345573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f634557a expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788587441.989093:0:23983:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788587441.989096:0:23983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788587441.989097:0:23983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587441.989099:0:23983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587441.989101:0:23983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587441.989102:0:23983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587441.989104:0:23983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587441.989106:0:23983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587441.989108:0:23983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587441.989111:0:23983:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788587441.989114:0:23983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788587441.989115:0:23983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788587441.989117:0:23983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587441.989118:0:23983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587441.989120:0:23983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587441.989121:0:23983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587441.989122:0:23983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587441.989124:0:23983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587441.989125:0:23983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587441.989150:0:23983:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788587441.989168:0:23983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310088320:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788587441.989229:0:23983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587441.989273:0:23983:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587441.989288:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310088320 00000100:00100000:0.0:1788587441.989296:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310088320 00000100:00100000:0.0:1788587441.989349:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788587441.989367:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:23983:x1875469310088320:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788587441.989413:0:21949:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788587441.989429:0:21949:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788587442.030103:0:21949:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788587442.030150:0:21949:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788587442.031202:0:21971:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788587442.031209:0:21971:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788587442.031233:0:21971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587442.031253:0:21971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f27200/0x419e1ae1f6345526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634551f expref: 24 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587442.031275:0:21971:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f26200/0x419e1ae1f6345534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634552d expref: 24 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587442.031283:0:21971:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587442.031323:0:21971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f26200/0x419e1ae1f6345534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634552d expref: 24 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587442.031340:0:21971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f26200/0x419e1ae1f6345534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634552d expref: 24 pid: 21948 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587442.031355:0:21971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310088448:0@lo:104: 00000100:00100000:2.0:1788587442.031435:0:21971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587442.031516:0:21971:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f27200/0x419e1ae1f6345526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f634551f expref: 24 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587442.031525:0:21971:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f27200/0x419e1ae1f6345526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f634551f expref: 24 pid: 21949 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587442.031535:0:21971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310088576:0@lo:104: 00000100:00100000:2.0:1788587442.031558:0:21971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587442.033241:0:21971:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03633900 going to sleep for 11 seconds 00000100:00100000:0.0:1788587442.033521:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310088448 00000100:00100000:0.0:1788587442.033530:0:21939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310088448 00000100:00100000:0.0:1788587442.033573:0:21939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310088576 00000100:00100000:0.0:1788587442.033591:0:21939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310088576 00000100:00100000:0.0:1788587442.033962:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587442.033974:0:21939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+4:21971:x1875469310088448:12345-0@lo:104: 00010000:00010000:0.0:1788587442.033991:0:21939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034069:0:21939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587442.034075:0:21939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+4:21971:x1875469310088448:12345-0@lo:104: Request processed in 105us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587442.034083:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587442.034101:0:21939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587442.034107:0:21939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:21971:x1875469310088576:12345-0@lo:104: 00010000:00010000:0.0:1788587442.034114:0:21939:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034146:0:21939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788587442.034151:0:21939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:21971:x1875469310088576:12345-0@lo:104: Request processed in 45us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587442.034157:0:21939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788587442.034174:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587442.034179:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034186:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27600 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587442.034190:0:21944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034199:0:21944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587442.034217:0:21944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587442.034224:0:21944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587442.034258:0:21944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034264:0:21944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587442.034283:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034291:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe05f27600/0x419e1ae1f634552d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345534 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034307:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587442.034311:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034316:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587442.034319:0:21944:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034325:0:21944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587442.034330:0:21944:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587442.034336:0:21944:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587442.034356:0:21944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034362:0:21944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587442.034368:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034375:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbe05f26c00/0x419e1ae1f634551f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f6345526 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.034409:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587442.034411:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587442.034413:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587442.034421:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587442.034440:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310088704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587442.034477:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587442.034508:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587442.034513:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310088832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587442.034532:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587442.034559:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310088704 00000100:00100000:0.0:1788587442.034563:0:21941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310088704 00010000:00010000:0.0:1788587442.034580:0:21941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f26200/0x419e1ae1f6345534 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634552d expref: 25 pid: 21948 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587442.034612:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310088832 00000100:00100000:0.0:1788587442.034621:0:21941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310088832 00000100:00100000:3.0:1788587442.034954:0:21971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310088448:0@lo:104: 00000100:00100000:3.0:1788587442.034966:0:21971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:21971:1875469310088576:0@lo:104: 00010000:00010000:3.0:1788587442.034986:0:21971:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035275:0:21941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f27200/0x419e1ae1f6345526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634551f expref: 26 pid: 21949 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587442.035292:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587442.035301:0:21941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+26:3474:x1875469310088704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587442.035322:0:21941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587442.035328:0:21941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f26200/0x419e1ae1f6345534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634552d expref: 26 pid: 21948 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035339:0:21941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f26200/0x419e1ae1f6345534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634552d expref: 26 pid: 21948 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035354:0:21941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f26200/0x419e1ae1f6345534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634552d expref: 26 pid: 21948 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035372:0:21941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587442.035430:0:21941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+25:3474:x1875469310088704:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587442.035437:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587442.035454:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587442.035462:0:21941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:3474:x1875469310088832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587442.035470:0:21941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587442.035475:0:21941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f27200/0x419e1ae1f6345526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f634551f expref: 24 pid: 21949 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035484:0:21941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f27200/0x419e1ae1f6345526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f634551f expref: 24 pid: 21949 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035493:0:21941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f27200/0x419e1ae1f6345526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f634551f expref: 24 pid: 21949 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035507:0:21941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035514:0:21941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788587442.035534:0:21941:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005067959s 00010000:00010000:0.0:1788587442.035539:0:21941:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035547:0:21941:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035553:0:21941:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035559:0:21941:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035565:0:21941:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42045e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587442.035570:0:21941:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035578:0:21941:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035592:0:21941:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587442.035607:0:21941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587442.035608:0:21971:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587442.035648:0:21941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:3474:x1875469310088832:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587442.035654:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788587442.035738:0:21971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587442.035746:0:21971:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63455ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587442.036353:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310088832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587442.036375:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310088704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587442.046780:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:23983:x1875469310088320:12345-0@lo:253:mount.lustre.0 Request processed in 57408us (57541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587442.046913:0:23983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10944000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:23983:1875469310088320:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788587442.046929:0:23983:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788587442.046943:0:23983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587442.046945:0:23983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788587442.046946:0:23983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587442.046948:0:23983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587442.046949:0:23983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587442.046950:0:23983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587442.046951:0:23983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587442.046953:0:23983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587442.046955:0:23983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788587442.046968:0:23983:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788587442.047516:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00080000:10000000:0.0:1788587442.047933:0:23983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587442.048152:0:23983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587442.048320:0:23983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587442.049298:0:23983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587442.049488:0:23983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587442.050552:0:23983:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788587442.051559:0:23983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788587442.129208:0:23983:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788587442.129220:0:23983:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788587442.129256:0:23983:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788587442.129314:0:23983:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788587442.129326:0:23983:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788587442.129357:0:23983:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788587442.412365:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587442.732559:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310089088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587442.732628:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587442.732670:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587442.732677:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310088960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587442.732700:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587442.732731:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310089088 00000100:00100000:0.0:1788587442.732738:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310089088 00000100:00100000:1.0:1788587442.733097:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310088960 00000100:00100000:1.0:1788587442.733113:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310088960 00000100:00100000:1.0:1788587442.733151:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788587442.733160:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310089088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587442.733194:0:21961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788587442.733258:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310089088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587442.733264:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788587442.733281:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788587442.733288:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310088960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788587442.733306:0:21961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587442.733334:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310088960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587442.733339:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788587442.733658:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310088960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587442.733672:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310089088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587442.996436:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587427/real 1788587427] req@ffff8cbf35d57100 x1875469310075776/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587442 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587442.996480:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf35d57100 x1875469310075776/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587442 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587442.996490:0:3471:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587427/real 1788587427] req@ffff8cbf35d55880 x1875469310075904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587442 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587442.996575:0:3471:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbf35d55880 x1875469310075904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587442 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788587442.996594:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587442.996660:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788587442.996664:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310075776:0@lo:8:kworker.0 00000100:00080000:0.0:1788587442.996671:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587442.996762:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587442.996772:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788587442.996775:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587442.996784:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbf10d7a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587442.996826:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf07c2f800 x1875469310089472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587442.996858:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587442.996861:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788587442.996863:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587442.996867:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 625 00000100:00080000:2.0:1788587442.996871:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:3.0:1788587442.996873:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1788587442.996874:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8cbe03e1a000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:3.0:1788587442.996885:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310089600:0@lo:400:kworker.0 00000100:00100000:2.0:1788587442.996885:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf07c2ed80 x1875469310089728/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587442.996893:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587442.996896:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788587442.996897:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587442.996899:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 625 00000100:00080000:2.0:1788587442.996902:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788587442.996904:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8cbe03e1c000 using connection 192.168.203.114@tcp/0@lo 00000100:00100000:2.0:1788587442.996913:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbf07c2d180 x1875469310089856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587442.996940:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587442.996969:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310089984:0@lo:400:kworker.0 00000100:00100000:2.0:1788587442.996969:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469310090368:0@lo:400:kworker.0 00000100:00100000:3.0:1788587442.996991:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587442.997046:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310089216:0@lo:400:kworker.0 00000100:00080000:0.0:1788587442.999630:0:3471:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788587442.999640:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310075904:0@lo:8:kworker.0 00000100:00100000:0.0:1788587442.999690:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310089344:0@lo:400:kworker.0 00000100:00100000:1.0:1788587442.999826:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587442.999865:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310090112:0@lo:400:kworker.0 00000100:00100000:1.0:1788587442.999895:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587442.999930:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310089600 00000100:00100000:1.0:1788587442.999937:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310089600 00000100:00100000:1.0:1788587442.999989:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310089984 00000100:00100000:1.0:1788587442.999992:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310089984 00000100:00100000:1.0:1788587443.000847:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310090112 00000100:00100000:1.0:1788587443.000853:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310090112 00000100:00100000:1.0:1788587443.000885:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788587443.000895:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310089600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587443.000979:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310089600:12345-0@lo:400:kworker.0 Request processed in 85us (4037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.000986:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788587443.001293:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788587443.001300:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310089984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587443.001335:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3473:x1875469310089984:12345-0@lo:400:kworker.0 Request processed in 37us (4343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.001341:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788587443.001352:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587443.001359:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469310090112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587443.001406:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469310090112:12345-0@lo:400:kworker.0 Request processed in 48us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.001412:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788587443.001436:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310089216 00000100:00100000:1.0:1788587443.001440:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310089216 00000100:00100000:1.0:1788587443.001467:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788587443.001474:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:3474:x1875469310089216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587443.001588:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:3474:x1875469310089216:12345-0@lo:400:kworker.0 Request processed in 114us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.001594:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788587443.001650:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310089216:0@lo:400:kworker.0 00010000:00080000:1.0:1788587443.001668:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf340c3100 x1875469310090112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587443.001681:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310090112:0@lo:400:kworker.0 00000100:00100000:1.0:1788587443.001884:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310089472:0@lo:8:kworker.0 00000100:00100000:1.0:1788587443.001918:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587443.001951:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310089472 00000100:00100000:1.0:1788587443.002106:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310089472 00000100:00100000:1.0:1788587443.002140:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587443.002155:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3471:x1875469310089472:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788587443.002182:0:23264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:1.0:1788587443.002210:0:23264:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x419e1ae1f63455b2 00002000:00100000:1.0:1788587443.002224:0:23264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cbf33f93800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788587443.002229:0:23264:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788587443.002231:0:23264:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788587443.002911:0:23264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788587443.002936:0:23264:0:(import.c:65:import_set_state_nolock()) ffff8cbf33f90000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587443.003170:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3471:x1875469310089472:12345-0@lo:8:kworker.0 Request processed in 1022us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.003179:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788587443.003228:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf07c2f800 x1875469310089472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587443.003242:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788587443.003249:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788587443.003254:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788587443.003256:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbf10d7a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788587443.003280:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788587443.003285:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3471:1875469310089472:0@lo:8:kworker.0 00000004:00080000:1.0:1788587443.003323:0:21982:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788587443.003341:0:21982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21982:1875469310090752:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788587443.003372:0:21982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587443.003399:0:21982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf27182cc0 going to sleep for 11 seconds 00000004:00080000:3.0:1788587443.003407:0:21981:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788587443.003416:0:23267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310090752 00000100:00100000:1.0:1788587443.003421:0:23267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310090752 00000100:00100000:1.0:1788587443.003462:0:23267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788587443.003468:0:23267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:21982:x1875469310090752:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788587443.004122:0:21981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640753326336ns, next at 0ns, rc = 0 00010000:00080000:3.0:1788587443.004520:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf340c2d80 x1875469310089984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587443.004533:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3473:1875469310089984:0@lo:400:kworker.0 00000100:00100000:3.0:1788587443.004541:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310090496:0@lo:400:kworker.0 00000100:00100000:3.0:1788587443.004962:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788587443.004999:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf07c2dc00 x1875469310089600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587443.005009:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310089600:0@lo:400:kworker.0 00000100:00100000:2.0:1788587443.005504:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587443.006470:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310090624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587443.006526:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587443.006571:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310090496 00000100:00100000:2.0:1788587443.006578:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310090496 00000100:00100000:2.0:1788587443.006626:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310090368 00000100:00100000:2.0:1788587443.006629:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310090368 00000100:00100000:2.0:1788587443.006648:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587443.006656:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469310090496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587443.006733:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3473:x1875469310090496:12345-0@lo:400:kworker.0 Request processed in 77us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587443.006740:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587443.006756:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788587443.006761:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469310090368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587443.006807:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3472:x1875469310090368:12345-0@lo:400:kworker.0 Request processed in 32us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587443.006814:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788587443.006847:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf340c1c00 x1875469310090368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587443.006861:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3472:1875469310090368:0@lo:400:kworker.0 00000100:00100000:2.0:1788587443.006902:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310089728:0@lo:8:kworker.0 00000100:00100000:2.0:1788587443.006928:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587443.006955:0:3471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310089856:0@lo:8:kworker.0 00000100:00100000:2.0:1788587443.006975:0:3471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587443.006993:0:23264:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587443.007001:0:23264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788587443.007158:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587443.007174:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469310090240:0@lo:400:kworker.0 00000100:00100000:0.0:1788587443.007196:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587443.007235:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310090240 00000100:00100000:0.0:1788587443.007239:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310090240 00000100:00100000:0.0:1788587443.007262:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587443.007269:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469310090240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587443.007305:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469310090240:12345-0@lo:400:kworker.0 Request processed in 36us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587443.007311:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788587443.007336:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587443.007340:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587443.007342:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788587443.007364:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf340c0000 x1875469310090496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587443.007375:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3473:1875469310090496:0@lo:400:kworker.0 00002000:00080000:1.0:1788587443.007633:0:23267:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788587443.007640:0:23267:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1788587443.007645:0:23267:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00000100:00100000:3.0:1788587443.013139:0:23268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310090624 00000100:00100000:3.0:1788587443.013160:0:23268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310090624 00000100:00100000:3.0:1788587443.013416:0:23268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587443.013428:0:23268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3474:x1875469310090624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587443.013452:0:23268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587443.013543:0:23268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3474:x1875469310090624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (7016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587443.013550:0:23268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788587443.013602:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bd51880 x1875469310090624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587443.013637:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310090624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587443.013866:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310089728 00000100:00100000:3.0:1788587443.013872:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310089728 00000100:00100000:3.0:1788587443.013891:0:23264:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788587443.013898:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310089856 00000100:00100000:3.0:1788587443.013901:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310089856 00000100:00100000:3.0:1788587443.013908:0:23264:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788587443.013911:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310089344 00000100:00100000:3.0:1788587443.013914:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310089344 00000100:00100000:3.0:1788587443.013941:0:23264:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788587443.013948:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587443.013954:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310089344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587443.013992:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310089344:12345-0@lo:400:kworker.0 Request processed in 39us (6835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587443.013999:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587443.014068:0:24056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587443.014073:0:24056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3471:x1875469310089728:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788587443.014097:0:24056:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:3.0:1788587443.014136:0:24056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f63455b9 00002000:00100000:3.0:1788587443.014150:0:24056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8cbf35e5a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788587443.014153:0:24056:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788587443.014156:0:24056:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1788587443.014181:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788587443.014776:0:24056:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788587443.014820:0:24056:0:(import.c:65:import_set_state_nolock()) ffff8cbf35e5b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587443.014873:0:24056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3471:x1875469310089728:12345-0@lo:8:kworker.0 Request processed in 798us (7942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587443.014880:0:24056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587443.014895:0:24056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587443.014899:0:24056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3471:x1875469310089856:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788587443.014916:0:24056:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:3.0:1788587443.014933:0:24056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x419e1ae1f63455c0 00002000:00100000:3.0:1788587443.014940:0:24056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8cbf35e5e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788587443.014943:0:24056:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788587443.014945:0:24056:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788587443.014989:0:24056:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788587443.015002:0:24056:0:(import.c:65:import_set_state_nolock()) ffff8cbf35e58800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587443.015011:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587443.015019:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788587443.015026:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:3.0:1788587443.015028:0:24056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3471:x1875469310089856:12345-0@lo:8:kworker.0 Request processed in 128us (8053us total) trans 0 rc 0/0 00000100:00080000:2.0:1788587443.015030:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788587443.015033:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788587443.015034:0:24056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:2.0:1788587443.015053:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788587443.015058:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310089728:0@lo:8:kworker.0 00010000:00080000:2.0:1788587443.015072:0:3471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf07c2d180 x1875469310089856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587443.015081:0:3471:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000004:00080000:3.0:1788587443.015082:0:22599:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00080000:2.0:1788587443.015085:0:3471:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788587443.015089:0:3471:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788587443.015091:0:3471:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788587443.015093:0:3471:0:(import.c:65:import_set_state_nolock()) ffff8cbe03e1c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788587443.015098:0:22599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22599:1875469310091008:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788587443.015110:0:3471:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788587443.015114:0:3471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3471:1875469310089856:0@lo:8:kworker.0 00000100:00100000:3.0:1788587443.015130:0:22599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587443.015142:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310091008 00000100:00100000:2.0:1788587443.015146:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310091008 00000100:00100000:3.0:1788587443.015147:0:22599:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03630d80 going to sleep for 11 seconds 00000004:00080000:3.0:1788587443.015159:0:22598:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788587443.015173:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587443.015180:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:22599:x1875469310091008:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788587443.015594:0:22598:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 640764798681ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788587443.015613:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587443.015623:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310090880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587443.015652:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587443.015686:0:23268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310090880 00000100:00100000:3.0:1788587443.015690:0:23268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310090880 00000100:00100000:3.0:1788587443.015709:0:23268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587443.015715:0:23268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3474:x1875469310090880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587443.015733:0:23268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788587443.015767:0:23268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3474:x1875469310090880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587443.015774:0:23268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587443.015821:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310090880:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1788587443.021932:0:22602:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788587443.021965:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22602:1875469310091264:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788587443.022044:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587443.022076:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf034a9300 going to sleep for 11 seconds 00000004:00080000:1.0:1788587443.022095:0:22601:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788587443.022457:0:22601:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 640771661822ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788587443.022729:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310091136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587443.022763:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587443.023867:0:23268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310091136 00000100:00100000:1.0:1788587443.023879:0:23268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310091136 00000100:00100000:1.0:1788587443.023930:0:23268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587443.023945:0:23268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3472:x1875469310091136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587443.023969:0:23268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587443.024111:0:23268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3472:x1875469310091136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 173us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.024118:0:23268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788587443.024760:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3bd51880 x1875469310091136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587443.024781:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310091136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788587443.026887:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310089344:0@lo:400:kworker.0 00010000:00080000:0.0:1788587443.026908:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf340c3b80 x1875469310090240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587443.026919:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469310090240:0@lo:400:kworker.0 00000100:00100000:1.0:1788587443.031977:0:23265:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788587443.032002:0:23265:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:1.0:1788587443.034634:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.034648:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.034667:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.034672:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.034679:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.034698:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.034709:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.034717:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.034753:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587443.035226:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.035234:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.035243:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.035249:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.035258:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.035278:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.035285:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.035306:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.035308:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.035310:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.038840:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.038853:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.038870:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.038875:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.038881:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.038906:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.038916:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.038924:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.038947:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587443.039091:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.039099:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.039107:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cca00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.039112:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.039121:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.039138:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.039145:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.039162:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.039164:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.039166:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.040708:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.040717:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.040732:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.040737:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.040743:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.040756:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.040767:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.040787:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.040830:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587443.041603:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.041612:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.041622:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.041626:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.041649:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.041666:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.041674:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.041692:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.041694:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.041696:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587443.042436:0:24056:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788587443.042450:0:24056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310091264 00000100:00100000:3.0:1788587443.042459:0:24056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310091264 00000100:00080000:2.0:1788587443.042619:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587443.042624:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587443.045329:0:24058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587443.045347:0:24058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:22602:x1875469310091264:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:2.0:1788587443.045958:0:23264:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788587443.045968:0:23264:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788587443.047102:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:22599:x1875469310091008:12345-0@lo:7:osp-pre-0-1.0 Request processed in 31915us (31963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587443.047114:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587443.048340:0:22599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22599:1875469310091008:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788587443.048357:0:22599:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788587443.048408:0:22599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22599:1875469310091392:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788587443.048457:0:22599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587443.048483:0:22599:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03630d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587443.048769:0:24056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310091392 00000100:00100000:3.0:1788587443.048776:0:24056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310091392 00000100:00100000:3.0:1788587443.048837:0:24056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587443.048846:0:24056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22599:x1875469310091392:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788587443.048871:0:24056:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788587443.048911:0:24056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:22599:x1875469310091392:12345-0@lo:5:osp-pre-0-1.0 Request processed in 66us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587443.048918:0:24056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587443.048944:0:22599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22599:1875469310091392:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788587443.048954:0:22599:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788587443.048985:0:22599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22599:1875469310091520:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788587443.049147:0:22599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587443.049165:0:22599:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03630d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587443.049179:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310091520 00000100:00100000:3.0:1788587443.049183:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310091520 00000100:00100000:3.0:1788587443.049200:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587443.049206:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:22599:x1875469310091520:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788587443.049238:0:23264:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00002000:00080000:1.0:1788587443.052276:0:24058:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788587443.052284:0:24058:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788587443.052363:0:24058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:22602:x1875469310091264:12345-0@lo:7:osp-pre-1-1.0 Request processed in 7019us (30315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.052373:0:24058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587443.052435:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd52300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22602:1875469310091264:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788587443.052449:0:22602:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788587443.052485:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22602:1875469310091648:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788587443.052516:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587443.052537:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf126cf840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587443.052551:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310091648 00000100:00100000:1.0:1788587443.052556:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310091648 00000100:00100000:1.0:1788587443.052584:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788587443.052592:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:22602:x1875469310091648:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788587443.052616:0:23265:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788587443.052645:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:22602:x1875469310091648:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.052651:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788587443.052673:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22602:1875469310091648:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788587443.052688:0:22602:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788587443.052710:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22602:1875469310091776:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788587443.052730:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587443.052742:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf126cf840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587443.052752:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310091776 00000100:00100000:1.0:1788587443.052755:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310091776 00000100:00100000:1.0:1788587443.052769:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587443.052774:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:22602:x1875469310091776:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788587443.052834:0:23265:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:1.0:1788587443.082842:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.082854:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f63455dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.082871:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.082876:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.082883:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f63455dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.082896:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f63455dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.082906:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f63455dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.082914:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f63455dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.082941:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587443.083756:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.083765:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f63455dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.083775:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.083780:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f63455dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.083790:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f63455dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.083824:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f63455dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.083844:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f63455dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.083864:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.083866:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.083868:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.085782:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.085808:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f63455e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.085825:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.085830:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.085836:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f63455e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.085850:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f63455e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.085860:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f63455e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.085868:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f63455e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.085886:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587443.085897:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587443.085903:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f63455e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.085911:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421ccc00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.085921:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f63455e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.085932:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f63455e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.086654:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f63455e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.086666:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f63455e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.086685:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.086687:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.086689:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.087362:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.087369:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.087390:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.087395:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.087400:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.087412:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.087421:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.087436:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.087455:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587443.087837:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587443.087844:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.087853:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587443.087858:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.087867:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.087885:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.087893:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f63455ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.087908:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587443.087915:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587443.087917:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.087923:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.087928:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.087937:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.087940:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.087944:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.087953:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.087961:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.087968:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.087980:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587443.087988:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587443.088005:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088018:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cca00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.088021:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088030:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088041:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088048:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f63455f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088060:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.088062:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.088063:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.088456:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.088462:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088471:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.088474:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.088478:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088487:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088501:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088509:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088530:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587443.088937:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.088943:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63455ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088953:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.088956:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.088960:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63455ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088969:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63455ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088978:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63455ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.088985:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63455ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089011:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587443.089022:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587443.089027:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089033:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.089037:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089045:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089058:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089065:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f63455f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.089078:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587443.089078:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.089079:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.089081:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587443.089083:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63455ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.089090:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587443.089093:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63455ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.089101:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63455ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.089112:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63455ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.089120:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63455ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.089132:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587443.089133:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587443.089135:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.089454:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.089460:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345606 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089470:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.089479:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.089485:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089495:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089504:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089512:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089527:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587443.089535:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587443.089539:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089546:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.089550:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089558:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089569:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345606 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089587:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345606 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.089601:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.089603:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.089605:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.100433:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.100446:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634560d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.100462:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.100467:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.100473:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634560d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.100489:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634560d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.101195:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634560d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.101206:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634560d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.101240:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587443.101893:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587443.101901:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634560d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.101911:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421ccc00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587443.101916:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634560d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.101932:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634560d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.101951:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634560d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.101958:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634560d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.101977:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587443.101979:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587443.101981:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.102922:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.102936:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345614 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.102950:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.102955:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.102961:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.102973:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.102982:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.102990:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.104088:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587443.104102:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587443.104109:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.104119:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.104124:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.104135:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345614 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.104159:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345614 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.104166:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345614 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.104188:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.104189:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.104191:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.106360:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.106373:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f634561b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.107674:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.107682:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.107690:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f634561b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.107708:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f634561b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.107719:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f634561b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.107727:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f634561b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.110866:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587443.111334:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.111343:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345622 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111361:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.111366:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.111372:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111397:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111407:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111415:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111431:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587443.111441:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587443.111447:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f634561b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587443.111449:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587443.111455:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.111465:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f634561b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111475:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f634561b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111491:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f634561b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111499:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f634561b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111518:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.111520:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.111521:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.111919:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.111926:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f6345629 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111935:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.111938:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.111943:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f6345629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111952:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f6345629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111960:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f6345629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111974:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f6345629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.111988:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587443.111997:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587443.112001:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f6345629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.112007:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cca00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.112011:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f6345629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.112019:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f6345629 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.112031:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f6345629 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.112038:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f6345629 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.112052:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.112053:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.112055:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.113458:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.113469:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.113481:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.113485:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.113824:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345622 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.113846:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345622 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.113854:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345622 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.113878:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.113881:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.113884:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.114741:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.114745:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788587443.116653:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1788587443.116679:0:7270:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00010000:1.0:1788587443.118742:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.118754:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345630 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.118772:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.118776:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.118782:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.118809:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.118819:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.118827:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.118842:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587443.118853:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587443.118859:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.118866:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.118871:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.118889:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345630 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.118903:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345630 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.118910:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345630 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.118925:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.118927:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.118929:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587443.119168:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:22602:x1875469310091776:12345-0@lo:5:osp-pre-1-1.0 Request processed in 66388us (66431us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788587443.119180:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587443.119288:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:22602:1875469310091776:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788587443.119304:0:22602:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1788587443.119348:0:22602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf07c2ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:22602:1875469310091904:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788587443.119405:0:22602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587443.119432:0:22602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe04b419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587443.119464:0:21967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310091904 00000100:00100000:1.0:1788587443.119471:0:21967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310091904 00000100:00100000:1.0:1788587443.119589:0:21967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587443.119668:0:21967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22602:x1875469310091904:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788587443.119723:0:21967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22602:x1875469310091904:12345-0@lo:900:osp-pre-1-1.0 Request processed in 58us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.119731:0:21967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587443.120164:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10944000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:22599:x1875469310091520:12345-0@lo:5:osp-pre-0-1.0 Request processed in 70927us (70986us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788587443.120175:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788587443.120211:0:22602:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf07c2ce00 x1875469310091904/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587443.120223:0:22602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf07c2ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:22602:1875469310091904:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788587443.120346:0:22599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf35d55180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:22599:1875469310091520:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788587443.120356:0:22599:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788587443.120391:0:22599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:22599:1875469310092032:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788587443.120418:0:22599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587443.120445:0:22599:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf36f013c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587443.120645:0:21967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310092032 00000100:00100000:0.0:1788587443.120652:0:21967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310092032 00000100:00100000:0.0:1788587443.120685:0:21967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587443.120692:0:21967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22599:x1875469310092032:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788587443.120741:0:21967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:22599:x1875469310092032:12345-0@lo:900:osp-pre-0-1.0 Request processed in 48us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587443.120748:0:21967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788587443.120974:0:22599:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf10945880 x1875469310092032/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788587459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587443.120985:0:22599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf10945880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:22599:1875469310092032:0@lo:900:osp-pre-0-1.0 00002000:00010000:1.0:1788587443.121830:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.121841:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006db4e21a/0x419e1ae1f6345637 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.121857:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.121861:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.121868:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006db4e21a/0x419e1ae1f6345637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.121883:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006db4e21a/0x419e1ae1f6345637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.121893:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006db4e21a/0x419e1ae1f6345637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.121901:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006db4e21a/0x419e1ae1f6345637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.121915:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587443.122678:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.122688:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006db4e21a/0x419e1ae1f6345637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.122698:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cda00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.122703:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006db4e21a/0x419e1ae1f6345637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.122713:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006db4e21a/0x419e1ae1f6345637 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.122731:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006db4e21a/0x419e1ae1f6345637 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.122747:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006db4e21a/0x419e1ae1f6345637 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.122767:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.122769:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.122771:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.124298:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.124308:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f634563e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.124322:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.124326:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.124332:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f634563e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.124358:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f634563e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.124367:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f634563e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.124375:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f634563e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.124403:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587443.124930:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.124937:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345645 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.124946:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.124949:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.124953:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.124961:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.124969:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.124985:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.125070:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788587443.125482:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.125489:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f634564c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125596:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587443.125604:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f634563e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125613:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cca00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.125617:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f634563e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125626:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f634563e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125643:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f634563e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125651:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081a0886c/0x419e1ae1f634563e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125666:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.125670:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125682:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.125685:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125693:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345645 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125703:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345645 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125709:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085810448/0x419e1ae1f6345645 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125722:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.125723:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.125725:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.125761:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.125765:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.125769:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f634564c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.125779:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f634564c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.125787:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f634564c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.125837:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.125875:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f634564c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.125924:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587443.126388:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.126394:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345653 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.126409:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.126412:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.126416:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.126426:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.126435:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.126443:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587443.126904:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788587443.127009:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587443.127016:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f634564c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.127024:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cdc00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.127027:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f634564c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.127047:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f634564c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.127061:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f634564c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.127070:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f634564c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.127085:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.127089:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345653 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.127096:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.127099:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345653 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.127107:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345653 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.127117:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345653 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.127124:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.127126:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.127132:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.127326:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587443.127332:0:23267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f6345653 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587443.128257:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.128265:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634565a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.128276:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.128279:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.128285:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634565a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.128308:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634565a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.128317:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634565a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.128325:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634565a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.128400:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.128407:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634565a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.128415:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421ccc00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.128418:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634565a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.128426:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634565a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.128440:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634565a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587443.128566:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587443.128569:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587443.128571:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.128725:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587443.128731:0:23267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f634565a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587443.129224:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.129230:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345661 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.129239:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.129243:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.129247:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345661 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.129257:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345661 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.129276:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345661 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.129284:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345661 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.130872:0:24062:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.130883:0:24062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345661 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.130895:0:24062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.130900:0:24062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345661 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.130910:0:24062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345661 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.130927:0:24062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345661 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.130943:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.130945:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.130947:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.131083:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587443.131090:0:23267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345661 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587443.131749:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.131756:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f6345668 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.131768:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.131773:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.131779:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f6345668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.131791:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f6345668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.131828:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f6345668 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.131847:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f6345668 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.133707:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.133719:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f6345668 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.133733:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.133738:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f6345668 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.133750:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f6345668 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.133769:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f6345668 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.133779:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.133781:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.133783:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.134689:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587443.134699:0:23267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f6345668 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.134730:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.136241:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.136262:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f634566f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.136278:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.136282:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.136288:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f634566f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.136303:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f634566f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.136313:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f634566f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.136322:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f634566f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.136358:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587443.137097:0:24062:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.137104:0:24062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f634566f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.137113:0:24062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc200 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.137117:0:24062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f634566f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.137132:0:24062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f634566f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.137148:0:24062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f634566f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.137155:0:24062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023f54d9c/0x419e1ae1f634566f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.137173:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.137175:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.137176:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.138320:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.138330:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6345676 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.138343:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.138346:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.138351:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6345676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.138362:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6345676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.138371:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6345676 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.138388:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6345676 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.138410:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587443.139124:0:21944:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.139131:0:21944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6345676 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.139141:0:21944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.139147:0:21944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6345676 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.139157:0:21944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6345676 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.139174:0:21944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6345676 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.139194:0:21944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002da508f4/0x419e1ae1f6345676 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.139210:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.139212:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.139213:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.141750:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.141763:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f634567d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.141779:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.141789:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.141809:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f634567d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.141823:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f634567d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.141833:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f634567d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.141841:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f634567d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.141861:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587443.141874:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587443.141880:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f634567d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.141888:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.141892:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f634567d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.141901:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f634567d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.141915:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f634567d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.141933:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f634567d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.141951:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.141952:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.141954:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.144954:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.144968:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f6345684 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.144985:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.144989:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.147726:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f6345684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.147757:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f6345684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.147770:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f6345684 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.147779:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f6345684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.147830:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587443.147846:0:24062:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587443.147858:0:24062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f6345684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.147867:0:24062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421ccc00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.147871:0:24062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f6345684 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.147880:0:24062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f6345684 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.147896:0:24062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f6345684 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.147904:0:24062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e400ca2a/0x419e1ae1f6345684 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.147926:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.147928:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.147930:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.150236:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.150248:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f634568b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.150263:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.150268:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.150273:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f634568b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.150296:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f634568b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.150306:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f634568b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.150313:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f634568b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.150328:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587443.150945:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.150951:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f6345692 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.150962:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.150966:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.150970:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f6345692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.150980:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f6345692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151000:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f6345692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151020:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f6345692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151038:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788587443.151051:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587443.151057:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f634568b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151065:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.151069:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f634568b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151080:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f634568b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151097:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f634568b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151104:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0eb93aa/0x419e1ae1f634568b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151121:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587443.151124:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f6345692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151141:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cdc00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587443.151144:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f6345692 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151152:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f6345692 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151162:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f6345692 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151170:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003849fcea/0x419e1ae1f6345692 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.151183:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.151184:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587443.151186:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.151654:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.153406:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.153418:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345699 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.153432:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.153436:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.153443:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345699 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.153456:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345699 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.153473:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345699 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.153481:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345699 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.153514:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587443.155096:0:24062:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.155108:0:24062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345699 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.155121:0:24062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.155126:0:24062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345699 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.155136:0:24062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345699 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.155156:0:24062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345699 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.155164:0:24062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079dd510e/0x419e1ae1f6345699 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.155187:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.155189:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.155197:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587443.156838:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587443.156848:0:23267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63456a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.156865:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1788587443.156870:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587443.156876:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63456a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.156889:0:23267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63456a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.156899:0:23267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63456a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.156906:0:23267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63456a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.156937:0:23267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587443.157147:0:21943:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587443.157155:0:21943:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63456a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.157163:0:21943:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc800 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587443.157168:0:21943:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63456a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.157177:0:21943:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63456a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.157193:0:21943:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63456a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.157200:0:21943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce18df7/0x419e1ae1f63456a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.157217:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.157219:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587443.157221:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788587443.158975:0:23267:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1788587443.159787:0:23267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:21982:x1875469310090752:12345-0@lo:5:osp-pre-1-0.0 Request processed in 156314us (156409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.159822:0:23267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587443.167810:0:21982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21982:1875469310090752:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788587443.167829:0:21982:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788587443.177559:0:21982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21982:1875469310092160:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788587443.177732:0:21982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587443.177774:0:24056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310092160 00000100:00100000:1.0:1788587443.177781:0:24056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310092160 00000100:00100000:1.0:1788587443.177859:0:24056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587443.177868:0:24056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:21982:x1875469310092160:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788587443.177912:0:24056:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1788587443.186450:0:21982:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe04b419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587443.190154:0:24056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:21982:x1875469310092160:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12280us (12415us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788587443.190165:0:24056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587443.190226:0:21982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:21982:1875469310092160:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788587443.190241:0:21982:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1788587443.434953:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788587443.627041:0:21952:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788587443.627050:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf02a84800 from 14 10000000:01000000:0.0:1788587443.627056:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587443.627104:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ee00/0x419e1ae1f63456a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.627131:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ee00/0x419e1ae1f63456a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.627143:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ee00/0x419e1ae1f63456a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587443.627169:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310092288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587443.628785:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587443.628852:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03634b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587443.629739:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310092288 00000100:00100000:2.0:1788587443.629749:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310092288 00000100:00100000:2.0:1788587443.629829:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788587443.629839:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:21952:x1875469310092288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587443.629853:0:21949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587443.629870:0:21949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044800/0x419e1ae1f63456ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63456a7 expref: -99 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587443.629896:0:21949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044800/0x419e1ae1f63456ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63456a7 expref: 23 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587443.629907:0:21949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044800/0x419e1ae1f63456ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63456a7 expref: 23 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587443.629917:0:21949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044800, rc 0) 00000100:00100000:2.0:1788587443.629968:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:21952:x1875469310092288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587443.629990:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788587443.630366:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310092288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587443.630393:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ee00/0x419e1ae1f63456a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63456ae expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587443.630404:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ee00/0x419e1ae1f63456a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63456ae expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587443.630466:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3418b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310092416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788587443.630504:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587443.630542:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03634b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587443.630633:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310092416 00000100:00100000:1.0:1788587443.630638:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310092416 00000100:00100000:1.0:1788587443.630673:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788587443.630681:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:21952:x1875469310092416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788587443.630697:0:21948:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788587443.630714:0:21948:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788587443.630717:0:21948:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788587443.630818:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:21952:x1875469310092416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.630825:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788587443.630857:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3418b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310092416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788587443.630908:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788587443.630915:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ee00/0x419e1ae1f63456a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63456ae expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.630924:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ee00/0x419e1ae1f63456a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63456ae expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587443.630933:0:21952:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788587443.630935:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbf3b397800 from 14 10000000:01000000:1.0:1788587443.630938:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788587443.630958:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63456b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.630966:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63456b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.630974:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63456b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587443.630987:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310092544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587443.631008:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587443.631023:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe04b41540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587443.631033:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310092544 00000100:00100000:1.0:1788587443.631037:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310092544 00000100:00100000:1.0:1788587443.631052:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587443.631057:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:21952:x1875469310092544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587443.631069:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587443.631078:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f63456bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63456b5 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.631093:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f63456bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63456b5 expref: 24 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.631101:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cd400/0x419e1ae1f63456bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63456b5 expref: 24 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.631109:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cd400, rc 0) 00000100:00100000:1.0:1788587443.631136:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:21952:x1875469310092544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.631142:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587443.631169:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310092544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587443.631178:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63456b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63456bc expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.631199:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63456b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63456bc expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587443.631236:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310092672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788587443.631262:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587443.631274:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe04b41540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587443.631284:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310092672 00000100:00100000:1.0:1788587443.631287:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310092672 00000100:00100000:1.0:1788587443.631303:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788587443.631308:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:21952:x1875469310092672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788587443.631324:0:21948:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788587443.631332:0:21948:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788587443.631335:0:21948:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788587443.631407:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:21952:x1875469310092672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587443.631413:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788587443.631437:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310092672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788587443.631472:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788587443.631478:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63456b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63456bc expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587443.631485:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421ccc00/0x419e1ae1f63456b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63456bc expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587444.461476:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788587445.417506:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1788587445.417524:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1788587445.484084:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587445.807576:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587445.807598:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310092800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587445.807816:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587445.807849:0:23268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310092800 00000100:00100000:0.0:1788587445.807858:0:23268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310092800 00000100:00100000:0.0:1788587445.807907:0:23268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587445.807917:0:23268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310092800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587445.807948:0:23268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788587445.808009:0:23268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310092800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587445.808016:0:23268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788587445.808069:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587445.808504:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310092800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788587446.506939:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788587447.402263:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000001:00080000:2.0:1788587447.402302:0:9072:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788587447.402322:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788587447.402330:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1788587447.532964:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587447.851407:0:21990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788587447.851422:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310092928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587447.851655:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310093056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587447.851695:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587447.851947:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587447.852101:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310093056 00000100:00100000:0.0:1788587447.852108:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310093056 00000100:00100000:0.0:1788587447.852166:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310092928 00000100:00100000:0.0:1788587447.852170:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310092928 00000100:00100000:0.0:1788587447.852187:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587447.852195:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310093056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587447.852231:0:22600:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587447.852277:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310093056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587447.852284:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587447.852312:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587447.852319:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310092928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788587447.852336:0:22600:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587447.852376:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310092928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587447.852382:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587447.852420:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310093056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587447.852458:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310092928:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788587448.088553:0:24349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg314-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788587448.363449:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587448.363471:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310093184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587448.363536:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587448.364525:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310093696:0@lo:400:kworker.0 00000100:00100000:3.0:1788587448.364832:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310093312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587448.364864:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587448.364888:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310093824:0@lo:400:kworker.0 00000100:00100000:3.0:1788587448.364914:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587448.364936:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310094336:0@lo:400:kworker.0 00000100:00100000:3.0:1788587448.364959:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587448.364981:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469310094848:0@lo:400:kworker.0 00000100:00100000:3.0:1788587448.365011:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587448.365051:0:23269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310093184 00000100:00100000:3.0:1788587448.365058:0:23269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310093184 00000100:00100000:2.0:1788587448.365058:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310093824 00000100:00100000:2.0:1788587448.365066:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310093824 00000100:00100000:3.0:1788587448.365103:0:23269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310093312 00000100:00100000:3.0:1788587448.365106:0:23269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310093312 00000100:00100000:1.0:1788587448.365417:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587448.365455:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310094208:0@lo:400:kworker.0 00000100:00100000:1.0:1788587448.365482:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587448.365503:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310094720:0@lo:400:kworker.0 00000100:00100000:1.0:1788587448.365542:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587448.365854:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310093440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587448.365881:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587448.365893:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310093952:0@lo:400:kworker.0 00000100:00100000:1.0:1788587448.365911:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587448.365928:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310094464:0@lo:400:kworker.0 00000100:00100000:1.0:1788587448.365945:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587448.365962:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310094976:0@lo:400:kworker.0 00000100:00100000:1.0:1788587448.365987:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587448.366011:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788587448.366017:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310093568:0@lo:400:kworker.0 00000100:00100000:1.0:1788587448.366058:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587448.366082:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310094080:0@lo:400:kworker.0 00000100:00100000:1.0:1788587448.366104:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587448.366116:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310094592:0@lo:400:kworker.0 00000100:00100000:1.0:1788587448.366133:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587448.366169:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310093696 00000100:00100000:1.0:1788587448.366174:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310093696 00000100:00100000:1.0:1788587448.366202:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310094208 00000100:00100000:1.0:1788587448.366205:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310094208 00000100:00100000:1.0:1788587448.366219:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788587448.366228:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310093696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587448.366283:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310093696:12345-0@lo:400:kworker.0 Request processed in 54us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587448.366290:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788587448.366313:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788587448.366319:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310094208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587448.366364:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310094208:12345-0@lo:400:kworker.0 Request processed in 45us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587448.366370:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788587448.366910:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310093568 00000100:00100000:1.0:1788587448.366922:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310093696:0@lo:400:kworker.0 00000100:00100000:0.0:1788587448.366923:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310093568 00000100:00100000:1.0:1788587448.366939:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310094208:0@lo:400:kworker.0 00000100:00100000:0.0:1788587448.366965:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788587448.366975:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:3474:x1875469310093568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587448.367022:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:3474:x1875469310093568:12345-0@lo:400:kworker.0 Request processed in 49us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587448.367029:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788587448.367032:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3474:1875469310093568:0@lo:400:kworker.0 00000100:00100000:0.0:1788587448.367067:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310094848 00000100:00100000:0.0:1788587448.367072:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310094848 00000100:00100000:1.0:1788587448.367917:0:23267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310094336 00000100:00100000:1.0:1788587448.367925:0:23267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310094336 00000100:00100000:3.0:1788587448.368465:0:23269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310093440 00000100:00100000:3.0:1788587448.368471:0:23269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310093440 00000100:00100000:2.0:1788587448.368471:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310093952 00000100:00100000:2.0:1788587448.368478:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310093952 00000100:00100000:3.0:1788587448.368495:0:23269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587448.368507:0:23269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310093184:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587448.368512:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587448.368523:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310093824:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788587448.368545:0:23269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788587448.368590:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310093824:12345-0@lo:400:kworker.0 Request processed in 69us (3675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587448.368596:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587448.368610:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587448.368616:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469310093952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587448.368646:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3474:x1875469310093952:12345-0@lo:400:kworker.0 Request processed in 31us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587448.368651:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587448.369003:0:23269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310093184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 499us (5466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587448.369011:0:23269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788587448.369025:0:23269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587448.369032:0:23269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310093312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587448.369051:0:23269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587448.369084:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310094720 00000100:00100000:3.0:1788587448.369085:0:23269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310093312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (4219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587448.369090:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310094720 00000100:00100000:3.0:1788587448.369104:0:23269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587448.369119:0:23269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587448.369125:0:23269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3474:x1875469310093440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587448.369135:0:23269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587448.369173:0:23269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3474:x1875469310093440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (3292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587448.369178:0:23269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788587448.369246:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587448.369250:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587448.369255:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587448.369257:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587448.369270:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310094464 00000100:00100000:2.0:1788587448.369280:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310094464 00000100:00100000:2.0:1788587448.369302:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310094976 00000100:00100000:3.0:1788587448.369304:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310094080 00000100:00100000:2.0:1788587448.369306:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310094976 00000100:00100000:3.0:1788587448.369322:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310094080 00000100:00100000:2.0:1788587448.369326:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310094592 00000100:00100000:2.0:1788587448.369331:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310094592 00000100:00100000:3.0:1788587448.369358:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587448.369367:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469310094848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587448.369407:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3473:x1875469310094848:12345-0@lo:400:kworker.0 Request processed in 42us (4395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587448.369884:0:23267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587448.369892:0:23267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310094336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587448.369931:0:23267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310094336:12345-0@lo:400:kworker.0 Request processed in 40us (4971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587448.369937:0:23267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587448.369979:0:3474:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788587448.370001:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3474:1875469310093440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587448.370012:0:3474:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788587448.370021:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310093952:0@lo:400:kworker.0 00000100:00100000:2.0:1788587448.373967:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587448.373992:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310094720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587448.374219:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3472:x1875469310094720:12345-0@lo:400:kworker.0 Request processed in 122us (8558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587448.374230:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788587448.374253:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788587448.374261:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310094464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587448.374301:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3474:x1875469310094464:12345-0@lo:400:kworker.0 Request processed in 41us (8354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587448.374308:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788587448.374321:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788587448.374327:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469310094976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587448.374365:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3474:x1875469310094976:12345-0@lo:400:kworker.0 Request processed in 38us (8377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587448.374371:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788587448.374382:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587448.374388:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310094080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587448.374414:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3474:x1875469310094080:12345-0@lo:400:kworker.0 Request processed in 27us (8309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587448.374418:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587448.374429:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587448.374435:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469310094592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587448.374475:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3474:x1875469310094592:12345-0@lo:400:kworker.0 Request processed in 41us (8341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587448.374480:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788587448.374509:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587448.374514:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788587448.374547:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03d9c700 x1875469310094720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587448.374561:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3472:1875469310094720:0@lo:400:kworker.0 00010000:00080000:2.0:1788587448.374593:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2f800 x1875469310094080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587448.374601:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3474:1875469310094080:0@lo:400:kworker.0 00010000:00080000:2.0:1788587448.374613:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03d9c000 x1875469310094592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587448.374619:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3474:1875469310094592:0@lo:400:kworker.0 00010000:00080000:2.0:1788587448.374628:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03d9d500 x1875469310094464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587448.374636:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3474:1875469310094464:0@lo:400:kworker.0 00010000:00080000:2.0:1788587448.374644:0:3474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03d9ed80 x1875469310094976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587448.374651:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3474:1875469310094976:0@lo:400:kworker.0 00000100:00100000:3.0:1788587448.376788:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587448.377292:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310093312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587448.377308:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310093824:0@lo:400:kworker.0 00000100:00100000:3.0:1788587448.377321:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310094336:0@lo:400:kworker.0 00010000:00080000:3.0:1788587448.377338:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbe03d9e680 x1875469310094848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587448.377357:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3473:1875469310094848:0@lo:400:kworker.0 00000100:00100000:3.0:1788587448.377370:0:3473:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788587448.377388:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe0586f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310093184:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788587448.555194:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587449.582905:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587449.964643:0:22612:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587450.132206:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587450.132308:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292157184 00000100:00100000:2.0:1788587450.132328:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292157184 00000100:00100000:2.0:1788587450.132390:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 114 00000100:00100000:2.0:1788587450.132398:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3ab88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2408:x1875469292157184:12345-192.168.203.14@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788587450.132427:0:21947:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 75e0a861-ef0e-4e22-a4af-fd213f1f8b58@192.168.203.14@tcp t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:2.0:1788587450.132461:0:21947:0:(genops.c:1385:class_connect()) connect: client 75e0a861-ef0e-4e22-a4af-fd213f1f8b58, cookie 0x419e1ae1f63456c3 00000100:00080000:2.0:1788587450.132596:0:21947:0:(import.c:65:import_set_state_nolock()) ffff8cbe04b37800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587450.132666:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3ab88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+5:2408:x1875469292157184:12345-192.168.203.14@tcp:250:mount.lustre.0 Request processed in 266us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.132674:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 114 00000100:00100000:2.0:1788587450.141612:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587450.141827:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292157312 00000100:00100000:1.0:1788587450.141837:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292157312 00000100:00100000:1.0:1788587450.141903:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:1.0:1788587450.141914:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+5:18341:x1875469292157312:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788587450.141951:0:21949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587450.141972:0:21949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f63456ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d54 expref: -99 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587450.142001:0:21949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f63456ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d54 expref: 6 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587450.142014:0:21949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cda00/0x419e1ae1f63456ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d54 expref: 6 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587450.142023:0:21949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cda00, rc 0) 00000100:00100000:1.0:1788587450.142091:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+6:18341:x1875469292157312:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 178us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587450.142098:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 115 00000100:00100000:1.0:1788587450.144997:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587450.145252:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292157440 00000100:00100000:0.0:1788587450.145261:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292157440 00000100:00100000:0.0:1788587450.145313:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:0.0:1788587450.145324:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+6:18341:x1875469292157440:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587450.145687:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+6:18341:x1875469292157440:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 363us (697us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788587450.145695:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 116 00000100:00100000:0.0:1788587450.154923:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587450.155038:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292157568 00000100:00100000:2.0:1788587450.155049:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292157568 00000100:00100000:2.0:1788587450.155106:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:2.0:1788587450.155116:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+6:18341:x1875469292157568:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587450.155131:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587450.155147:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63456d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d5b expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587450.155173:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63456d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d5b expref: 7 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587450.155187:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42045e00/0x419e1ae1f63456d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d5b expref: 7 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587450.155196:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42045e00, rc 0) 00000100:00100000:2.0:1788587450.155254:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+7:18341:x1875469292157568:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 139us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.155276:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 117 00000100:00100000:2.0:1788587450.164001:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587450.164093:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292157696 00000100:00100000:0.0:1788587450.164103:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292157696 00000100:00100000:0.0:1788587450.164155:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:0.0:1788587450.164164:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+7:18341:x1875469292157696:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587450.164470:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+8:18341:x1875469292157696:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 306us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587450.164478:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 118 00000100:00100000:0.0:1788587450.168776:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587450.168962:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292157824 00000100:00100000:1.0:1788587450.168973:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292157824 00000100:00100000:1.0:1788587450.169021:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:1.0:1788587450.169029:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+8:18341:x1875469292157824:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788587450.169468:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+8:18341:x1875469292157824:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 438us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587450.169475:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 119 00000100:00100000:1.0:1788587450.183015:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587450.183296:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292157952 00000100:00100000:2.0:1788587450.183307:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292157952 00000100:00100000:2.0:1788587450.183375:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00100000:2.0:1788587450.183384:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+8:18359:x1875469292157952:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587450.183762:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+8:18359:x1875469292157952:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 377us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.183770:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 120 00000100:00100000:2.0:1788587450.205558:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587450.205652:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292158080 00000100:00100000:1.0:1788587450.205662:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292158080 00000100:00100000:1.0:1788587450.205727:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 121 00000100:00100000:1.0:1788587450.205738:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+8:18359:x1875469292158080:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587450.206187:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+8:18359:x1875469292158080:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 449us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587450.206196:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 121 00000100:00100000:1.0:1788587450.210455:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587450.210917:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292158208 00000100:00100000:0.0:1788587450.210927:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292158208 00000100:00100000:0.0:1788587450.210993:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00100000:0.0:1788587450.211003:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+8:18359:x1875469292158208:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587450.211245:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+8:18359:x1875469292158208:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 243us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587450.211254:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 122 00000100:00100000:0.0:1788587450.214039:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587450.214147:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292158336 00000100:00100000:2.0:1788587450.214157:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292158336 00000100:00100000:2.0:1788587450.214208:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 123 00000100:00100000:2.0:1788587450.214226:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+8:18341:x1875469292158336:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587450.214242:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587450.214258:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044400/0x419e1ae1f63456d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d8c expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587450.214287:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044400/0x419e1ae1f63456d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d8c expref: 9 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587450.214299:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044400/0x419e1ae1f63456d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d8c expref: 9 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587450.214308:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044400, rc 0) 00000100:00100000:2.0:1788587450.214379:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+9:18341:x1875469292158336:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 155us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.214401:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 123 00000100:00100000:2.0:1788587450.216509:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587450.216642:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292158464 00000100:00100000:1.0:1788587450.216651:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292158464 00000100:00100000:1.0:1788587450.216750:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 124 00000100:00100000:1.0:1788587450.216760:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+9:18341:x1875469292158464:12345-192.168.203.14@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788587450.216785:0:21949:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788587450.216850:0:21949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788587450.216855:0:21949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788587450.216858:0:21949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788587450.216862:0:21949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788587450.216869:0:21949:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788587450.219085:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+9:18341:x1875469292158464:12345-192.168.203.14@tcp:256:mount.lustre.0 Request processed in 2316us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.219100:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 124 00000100:00100000:0.0:1788587450.223573:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587450.223757:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292158592 00000100:00100000:2.0:1788587450.223769:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292158592 00000100:00100000:2.0:1788587450.223990:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 125 00000100:00100000:2.0:1788587450.224001:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+9:18341:x1875469292158592:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587450.224017:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587450.224043:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63456df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5d93 expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587450.224072:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63456df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d93 expref: 10 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587450.224085:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63456df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d93 expref: 10 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587450.224095:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044e00, rc 0) 00000100:00100000:2.0:1788587450.224150:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+10:18341:x1875469292158592:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 151us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.224156:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 125 00000100:00100000:1.0:1788587450.225655:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587450.225788:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292158720 00000100:00100000:2.0:1788587450.225907:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292158720 00000100:00100000:2.0:1788587450.225949:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 126 00000100:00100000:2.0:1788587450.225958:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+10:18341:x1875469292158720:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788587450.226227:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+10:18341:x1875469292158720:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 269us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.226235:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 126 00000100:00100000:0.0:1788587450.228502:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587450.228676:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292158848 00000100:00100000:2.0:1788587450.228685:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292158848 00000100:00100000:2.0:1788587450.228749:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 127 00000100:00100000:2.0:1788587450.228760:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3c251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+10:18341:x1875469292158848:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788587450.229502:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3c251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+10:18341:x1875469292158848:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 741us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.229513:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 127 00000100:00100000:0.0:1788587450.233077:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587450.233178:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292158976 00000100:00100000:2.0:1788587450.233188:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292158976 00000100:00100000:2.0:1788587450.233249:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:2.0:1788587450.233260:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+10:18364:x1875469292158976:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587450.233774:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+10:18364:x1875469292158976:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 511us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.233783:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 128 00000100:00100000:3.0:1788587450.236271:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587450.236445:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292159104 00000100:00100000:2.0:1788587450.236454:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292159104 00000100:00100000:2.0:1788587450.236534:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 129 00000100:00100000:2.0:1788587450.236542:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+10:18364:x1875469292159104:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587450.236837:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+10:18364:x1875469292159104:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 294us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.236845:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 129 00000100:00100000:0.0:1788587450.243191:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587450.243236:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587450.243475:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292159232 00000100:00100000:3.0:1788587450.243485:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292159232 00000100:00100000:1.0:1788587450.243762:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292159488 00000100:00100000:1.0:1788587450.243768:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292159488 00000100:00100000:0.0:1788587450.244324:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:0.0:1788587450.244342:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1875469292159232:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788587450.244374:0:23996:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bc3138d6-3c05-4ca5-96dc-2f3434542c99@192.168.203.14@tcp t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:0.0:1788587450.244432:0:23996:0:(genops.c:1385:class_connect()) connect: client bc3138d6-3c05-4ca5-96dc-2f3434542c99, cookie 0x419e1ae1f63456e6 00000004:00100000:0.0:1788587450.244462:0:23996:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788587450.244903:0:23996:0:(import.c:65:import_set_state_nolock()) ffff8cbf3abbc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587450.244972:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:2408:x1875469292159232:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 628us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587450.244980:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:0.0:1788587450.245016:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:0.0:1788587450.245021:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3418b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1875469292159488:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788587450.245038:0:23996:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from bc3138d6-3c05-4ca5-96dc-2f3434542c99@192.168.203.14@tcp t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:0.0:1788587450.246452:0:23996:0:(genops.c:1385:class_connect()) connect: client bc3138d6-3c05-4ca5-96dc-2f3434542c99, cookie 0x419e1ae1f63456ed 00000004:00100000:0.0:1788587450.246486:0:23996:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788587450.248383:0:23996:0:(import.c:65:import_set_state_nolock()) ffff8cbf3a711000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587450.248449:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3418b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:2408:x1875469292159488:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 3425us (5211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587450.248459:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:0.0:1788587450.250483:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587450.250521:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587450.250837:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292159744 00000100:00100000:1.0:1788587450.250847:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292159744 00000100:00100000:1.0:1788587450.250906:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292159360 00000100:00100000:1.0:1788587450.250909:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292159360 00000100:00100000:1.0:1788587450.250932:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:1.0:1788587450.250942:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:18341:x1875469292159744:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788587450.250982:0:21957:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587450.251054:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:18341:x1875469292159744:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 113us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587450.251061:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:1.0:1788587450.251092:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:1.0:1788587450.251111:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf07c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:0:x1875469292159360:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788587450.251122:0:21957:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587450.251156:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf07c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:0:x1875469292159360:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 47us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587450.251163:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00080000:3.0:1788587450.251442:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587450.258438:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587450.258515:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292159616 00000100:00100000:0.0:1788587450.258524:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292159616 00000100:00100000:0.0:1788587450.258597:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:0.0:1788587450.258607:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:0:x1875469292159616:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788587450.258650:0:21957:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587450.258744:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:0:x1875469292159616:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 139us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587450.258752:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00080000:3.0:1788587450.259176:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587450.266367:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587450.267272:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292159872 00000100:00100000:2.0:1788587450.267284:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292159872 00000100:00100000:2.0:1788587450.267393:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788587450.267404:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18341:x1875469292159872:12345-192.168.203.14@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788587450.267510:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18341:x1875469292159872:12345-192.168.203.14@tcp:40:mount.lustre.0 Request processed in 108us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.267519:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:0.0:1788587450.271950:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587450.273959:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587450.273997:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587450.274103:0:21966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292160256 00000100:00100000:1.0:1788587450.274113:0:21966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292160256 00000100:00100000:1.0:1788587450.274161:0:21966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:1.0:1788587450.274171:0:21966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18341:x1875469292160256:12345-192.168.203.14@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788587450.274256:0:21966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18341:x1875469292160256:12345-192.168.203.14@tcp:900:mount.lustre.0 Request processed in 86us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587450.274264:0:21966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:2.0:1788587450.274295:0:23267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292160000 00000100:00100000:2.0:1788587450.274299:0:23267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292160000 00000100:00100000:2.0:1788587450.274340:0:23267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292160128 00000100:00100000:2.0:1788587450.274343:0:23267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292160128 00000100:00100000:2.0:1788587450.274359:0:23267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788587450.274365:0:23267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2408:x1875469292160000:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788587450.274393:0:23267:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bc3138d6-3c05-4ca5-96dc-2f3434542c99@192.168.203.14@tcp t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:2.0:1788587450.274429:0:23267:0:(genops.c:1385:class_connect()) connect: client bc3138d6-3c05-4ca5-96dc-2f3434542c99, cookie 0x419e1ae1f63456f4 00002000:00100000:2.0:1788587450.274441:0:23267:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bc3138d6-3c05-4ca5-96dc-2f3434542c99/ffff8cbe04b36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788587450.274464:0:23267:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788587450.274642:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:1.0:1788587450.274647:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2408:x1875469292160128:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788587450.274666:0:23264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bc3138d6-3c05-4ca5-96dc-2f3434542c99@192.168.203.14@tcp t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:1.0:1788587450.274681:0:23264:0:(genops.c:1385:class_connect()) connect: client bc3138d6-3c05-4ca5-96dc-2f3434542c99, cookie 0x419e1ae1f63456fb 00002000:00100000:1.0:1788587450.274687:0:23264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bc3138d6-3c05-4ca5-96dc-2f3434542c99/ffff8cbf33f92800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788587450.274712:0:23264:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788587450.274936:0:23264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788587450.274968:0:23264:0:(import.c:65:import_set_state_nolock()) ffff8cbf33f95000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587450.275011:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:2408:x1875469292160128:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 361us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587450.275035:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00002000:00080000:2.0:1788587450.275784:0:23267:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788587450.275829:0:23267:0:(import.c:65:import_set_state_nolock()) ffff8cbe04b35800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587450.275860:0:23267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:2408:x1875469292160000:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 1494us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587450.275866:0:23267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:1.0:1788587450.283427:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587450.283773:0:21958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292160384 00000100:00100000:0.0:1788587450.283783:0:21958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292160384 00000100:00100000:0.0:1788587450.283876:0:21958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:0.0:1788587450.283887:0:21958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18341:x1875469292160384:12345-192.168.203.14@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788587450.290667:0:21958:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6714us 00000004:00200000:3.0:1788587450.322536:0:21958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788587450.322752:0:21958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18341:x1875469292160384:12345-192.168.203.14@tcp:33:mount.lustre.0 Request processed in 38862us (39329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587450.322765:0:21958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000001:00100000:1.0:1788587450.455767:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bc3138d6-3c05-4ca5-96dc-2f3434542c99 00000100:00100000:3.0:1788587450.511763:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587450.514212:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292160512 00000100:00100000:0.0:1788587450.514227:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292160512 00000100:00100000:0.0:1788587450.514358:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:0.0:1788587450.514369:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18387:x1875469292160512:12345-192.168.203.14@tcp:101:mkdir.0 00010000:00010000:0.0:1788587450.514389:0:21957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587450.514427:0:21957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5dc4 expref: -99 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587450.514492:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345709 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587450.514506:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587450.514520:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587450.514562:0:21957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587450.514566:0:21957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587450.514601:0:21957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587450.514625:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5dc4 expref: 8 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587450.514644:0:21957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345709 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5dc4 expref: 7 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587450.514652:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be800) 00010000:00010000:0.0:1788587450.514655:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587450.514659:0:21957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e000, rc 0) 00000100:00100000:0.0:1788587450.514730:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:18387:x1875469292160512:12345-192.168.203.14@tcp:101:mkdir.0 Request processed in 363us (2976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587450.514738:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00010000:00010000:0.0:1788587450.603131:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587450.923025:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310095104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587450.923108:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587450.923379:0:23269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310095104 00000100:00100000:1.0:1788587450.923388:0:23269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310095104 00000100:00100000:1.0:1788587450.923454:0:23269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587450.923464:0:23268:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788587450.923473:0:23268:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788587450.923477:0:23269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310095104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587450.923502:0:23269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788587450.923559:0:23269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310095104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587450.923566:0:23269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788587450.923627:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310095104:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788587450.924020:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788587451.627025:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587452.482751:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587452.482916:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292160640 00000100:00100000:2.0:1788587452.482933:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292160640 00000100:00100000:2.0:1788587452.482996:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:2.0:1788587452.483006:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:18439:x1875469292160640:12345-192.168.203.14@tcp:41:lfs.0 00000004:00000024:2.0:1788587452.483050:0:21955:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587452.483149:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:18439:x1875469292160640:12345-192.168.203.14@tcp:41:lfs.0 Request processed in 142us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587452.483158:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00080000:3.0:1788587452.483987:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587452.489027:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587452.489117:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292160768 00000100:00100000:0.0:1788587452.489126:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292160768 00000100:00100000:0.0:1788587452.489187:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:0.0:1788587452.489196:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18439:x1875469292160768:12345-192.168.203.14@tcp:41:lfs.0 00000004:00000024:0.0:1788587452.489231:0:23996:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788587452.489306:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18439:x1875469292160768:12345-192.168.203.14@tcp:41:lfs.0 Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587452.489313:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00080000:3.0:1788587452.489451:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587452.497002:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587452.497093:0:23269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292160896 00000100:00100000:2.0:1788587452.497104:0:23269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292160896 00000100:00100000:2.0:1788587452.497166:0:23269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:2.0:1788587452.497175:0:23269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:18439:x1875469292160896:12345-192.168.203.14@tcp:13:lfs.0 00002000:00000024:2.0:1788587452.497209:0:23269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788587452.497291:0:23269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:18439:x1875469292160896:12345-192.168.203.14@tcp:13:lfs.0 Request processed in 116us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587452.497300:0:23269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00080000:3.0:1788587452.497886:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587452.517566:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587452.517712:0:24465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292161024 00000100:00100000:2.0:1788587452.517722:0:24465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292161024 00000100:00100000:2.0:1788587452.517816:0:24465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00100000:2.0:1788587452.517829:0:24465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18439:x1875469292161024:12345-192.168.203.14@tcp:13:lfs.0 00002000:00000024:2.0:1788587452.517866:0:24465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587452.517942:0:24465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18439:x1875469292161024:12345-192.168.203.14@tcp:13:lfs.0 Request processed in 116us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587452.517950:0:24465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 12 00000100:00080000:0.0:1788587452.518238:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788587452.542059:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bc3138d6-3c05-4ca5-96dc-2f3434542c99 00010000:00010000:2.0:1788587452.652026:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587452.761191:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587452.762353:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292161152 00000100:00100000:2.0:1788587452.762379:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292161152 00000100:00100000:2.0:1788587452.762438:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 130 00000100:00100000:2.0:1788587452.762448:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+10:18473:x1875469292161152:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587452.762466:0:21949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587452.762483:0:21949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044000/0x419e1ae1f6345710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5dcb expref: -99 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587452.762513:0:21949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044000/0x419e1ae1f6345710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5dcb expref: 11 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587452.762538:0:21949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044000/0x419e1ae1f6345710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5dcb expref: 11 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587452.762548:0:21949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044000, rc 0) 00000100:00100000:2.0:1788587452.762613:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18473:x1875469292161152:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 166us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587452.762620:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 130 00000100:00100000:2.0:1788587452.769200:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587452.769368:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292161280 00000100:00100000:0.0:1788587452.769379:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292161280 00000100:00100000:0.0:1788587452.769439:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 131 00000100:00100000:0.0:1788587452.769449:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18473:x1875469292161280:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788587452.769741:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18473:x1875469292161280:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 292us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587452.769751:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 131 00000100:00100000:0.0:1788587452.774940:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587452.775046:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292161408 00000100:00100000:1.0:1788587452.775056:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292161408 00000100:00100000:1.0:1788587452.775177:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 132 00000100:00100000:1.0:1788587452.775188:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18473:x1875469292161408:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788587452.775429:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18473:x1875469292161408:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 241us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587452.775437:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 132 00000100:00100000:3.0:1788587452.779267:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587452.779718:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292161536 00000100:00100000:1.0:1788587452.779728:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292161536 00000100:00100000:1.0:1788587452.779823:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:1.0:1788587452.779836:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18478:x1875469292161536:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587452.780311:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18478:x1875469292161536:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 476us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587452.780455:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 133 00000100:00100000:2.0:1788587452.815031:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587452.815292:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292161664 00000100:00100000:0.0:1788587452.815302:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292161664 00000100:00100000:0.0:1788587452.815641:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:0.0:1788587452.815652:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18478:x1875469292161664:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587452.816377:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18478:x1875469292161664:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 724us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587452.816386:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 134 00000100:00100000:0.0:1788587452.826062:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587452.826227:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292161792 00000100:00100000:1.0:1788587452.826248:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292161792 00000100:00100000:1.0:1788587452.826545:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 135 00000100:00100000:1.0:1788587452.826566:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18478:x1875469292161792:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587452.826872:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18478:x1875469292161792:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 316us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587452.826881:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 135 00000100:00100000:3.0:1788587452.832061:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587452.832550:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292161920 00000100:00100000:0.0:1788587452.832680:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292161920 00000100:00100000:0.0:1788587452.832756:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 136 00000100:00100000:0.0:1788587452.832766:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18473:x1875469292161920:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587452.832939:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587452.832959:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499fe00/0x419e1ae1f6345717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5dfc expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587452.832991:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499fe00/0x419e1ae1f6345717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5dfc expref: 12 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587452.833002:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499fe00/0x419e1ae1f6345717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5dfc expref: 12 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587452.833010:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fe00, rc 0) 00000100:00100000:0.0:1788587452.833078:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+12:18473:x1875469292161920:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 313us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587452.833086:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 136 00000100:00100000:3.0:1788587452.839906:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587452.839979:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292162048 00000100:00100000:1.0:1788587452.839989:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292162048 00000100:00100000:1.0:1788587452.840077:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 137 00000100:00100000:1.0:1788587452.840088:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+12:18473:x1875469292162048:12345-192.168.203.14@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788587452.840114:0:21949:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788587452.840138:0:21949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788587452.840143:0:21949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788587452.840146:0:21949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788587452.840149:0:21949:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788587452.840152:0:21949:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788587452.844546:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+12:18473:x1875469292162048:12345-192.168.203.14@tcp:256:mount.lustre.0 Request processed in 4441us (4631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587452.844561:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 137 00000100:00100000:2.0:1788587452.857247:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587452.858411:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292162176 00000100:00100000:1.0:1788587452.858423:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292162176 00000100:00100000:1.0:1788587452.858486:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:1.0:1788587452.858508:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+12:18473:x1875469292162176:12345-192.168.203.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788587452.858523:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587452.858553:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634571e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e03 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587452.858582:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634571e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e03 expref: 13 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587452.858594:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634571e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e03 expref: 13 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587452.858604:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cc200, rc 0) 00000100:00100000:1.0:1788587452.858678:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18473:x1875469292162176:12345-192.168.203.14@tcp:101:mount.lustre.0 Request processed in 170us (2537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587452.858694:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 138 00000100:00100000:3.0:1788587452.878986:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587452.879329:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292162304 00000100:00100000:1.0:1788587452.879339:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292162304 00000100:00100000:1.0:1788587452.879503:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 139 00000100:00100000:1.0:1788587452.879517:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18473:x1875469292162304:12345-192.168.203.14@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788587452.879838:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18473:x1875469292162304:12345-192.168.203.14@tcp:501:mount.lustre.0 Request processed in 324us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587452.882190:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 139 00000100:00100000:3.0:1788587452.884118:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587452.884374:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292162432 00000100:00100000:1.0:1788587452.884385:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292162432 00000100:00100000:1.0:1788587452.884441:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 140 00000100:00100000:1.0:1788587452.884452:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bdb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18473:x1875469292162432:12345-192.168.203.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788587452.885091:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bdb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18473:x1875469292162432:12345-192.168.203.14@tcp:503:mount.lustre.0 Request processed in 637us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587452.885108:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 140 00000100:00100000:2.0:1788587452.894141:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587452.895404:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292162560 00000100:00100000:1.0:1788587452.895417:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292162560 00000100:00100000:1.0:1788587452.895480:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 141 00000100:00100000:1.0:1788587452.895491:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf115d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18483:x1875469292162560:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587452.895747:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf115d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18483:x1875469292162560:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 256us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587452.895757:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 141 00000100:00100000:3.0:1788587452.901927:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587452.902502:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292162688 00000100:00100000:1.0:1788587452.902513:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292162688 00000100:00100000:1.0:1788587452.902624:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 142 00000100:00100000:1.0:1788587452.902634:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf115d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18483:x1875469292162688:12345-192.168.203.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587452.902922:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf115d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18483:x1875469292162688:12345-192.168.203.14@tcp:502:llog_process_th.0 Request processed in 288us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587452.902931:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 142 00000100:00100000:3.0:1788587452.921020:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587452.921160:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587452.924033:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292162816 00000100:00100000:2.0:1788587452.924048:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292162816 00000100:00100000:2.0:1788587452.924091:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292163072 00000100:00100000:2.0:1788587452.924094:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292163072 00000100:00100000:2.0:1788587452.924173:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:2.0:1788587452.924181:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875469292162816:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788587452.924207:0:21955:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3ddd9e77-7692-4352-87e9-0155c2125e90@192.168.203.14@tcp t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:2.0:1788587452.924259:0:21955:0:(genops.c:1385:class_connect()) connect: client 3ddd9e77-7692-4352-87e9-0155c2125e90, cookie 0x419e1ae1f6345725 00000004:00100000:2.0:1788587452.924289:0:21955:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788587452.924435:0:21955:0:(import.c:65:import_set_state_nolock()) ffff8cbe04b34800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587452.924493:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+6:2408:x1875469292162816:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 311us (3484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587452.924500:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:2.0:1788587452.924516:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:2.0:1788587452.924520:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1875469292163072:12345-192.168.203.14@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788587452.924536:0:21955:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 3ddd9e77-7692-4352-87e9-0155c2125e90@192.168.203.14@tcp t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:2.0:1788587452.924558:0:21955:0:(genops.c:1385:class_connect()) connect: client 3ddd9e77-7692-4352-87e9-0155c2125e90, cookie 0x419e1ae1f634572c 00000004:00100000:2.0:1788587452.924572:0:21955:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788587452.924632:0:21955:0:(import.c:65:import_set_state_nolock()) ffff8cbe04b35000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587452.924657:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+6:2408:x1875469292163072:12345-192.168.203.14@tcp:38:mount.lustre.0 Request processed in 135us (3498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587452.924664:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:2.0:1788587452.935585:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587452.935616:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587452.935644:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587452.935776:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292163328 00000100:00100000:3.0:1788587452.935785:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292163328 00000100:00100000:3.0:1788587452.935868:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292163200 00000100:00100000:3.0:1788587452.935873:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292163200 00000100:00100000:3.0:1788587452.935886:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292162944 00000100:00100000:3.0:1788587452.935889:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292162944 00000100:00100000:3.0:1788587452.935901:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:3.0:1788587452.935910:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+7:18473:x1875469292163328:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788587452.935938:0:21957:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587452.935999:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+7:18473:x1875469292163328:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 90us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587452.936007:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:3.0:1788587452.936023:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:3.0:1788587452.936029:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+6:0:x1875469292163200:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788587452.936041:0:21957:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788587452.936067:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+6:0:x1875469292163200:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 38us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587452.936074:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:3.0:1788587452.936085:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:3.0:1788587452.936091:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+6:0:x1875469292162944:12345-192.168.203.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788587452.936100:0:21957:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587452.936118:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+6:0:x1875469292162944:12345-192.168.203.14@tcp:41:mount.lustre.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587452.936124:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00080000:2.0:1788587452.936519:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587452.936523:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587452.938890:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587452.941593:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292163456 00000100:00100000:0.0:1788587452.941608:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292163456 00000100:00100000:0.0:1788587452.941685:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:0.0:1788587452.941696:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+6:18473:x1875469292163456:12345-192.168.203.14@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788587452.941828:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+6:18473:x1875469292163456:12345-192.168.203.14@tcp:40:mount.lustre.0 Request processed in 97us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587452.941837:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:3.0:1788587452.950048:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587452.950098:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587452.950125:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587452.950210:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292163584 00000100:00100000:2.0:1788587452.950218:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292163584 00000100:00100000:2.0:1788587452.950261:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292163712 00000100:00100000:2.0:1788587452.950263:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292163712 00000100:00100000:2.0:1788587452.950280:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:2.0:1788587452.950289:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf35d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2408:x1875469292163584:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788587452.950349:0:23265:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3ddd9e77-7692-4352-87e9-0155c2125e90@192.168.203.14@tcp t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:2.0:1788587452.950379:0:23265:0:(genops.c:1385:class_connect()) connect: client 3ddd9e77-7692-4352-87e9-0155c2125e90, cookie 0x419e1ae1f6345733 00000100:00100000:1.0:1788587452.950387:0:21966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292163840 00002000:00100000:2.0:1788587452.950391:0:23265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ddd9e77-7692-4352-87e9-0155c2125e90/ffff8cbe04b37000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1788587452.950392:0:21966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292163840 00002000:00100000:2.0:1788587452.950410:0:23265:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788587452.950435:0:21966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:1.0:1788587452.950441:0:21966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe0586dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3ddd9e77-7692-4352-87e9-0155c2125e90+6:18473:x1875469292163840:12345-192.168.203.14@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788587452.950511:0:21966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe0586dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3ddd9e77-7692-4352-87e9-0155c2125e90+6:18473:x1875469292163840:12345-192.168.203.14@tcp:900:mount.lustre.0 Request processed in 69us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587452.950529:0:21966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00002000:00080000:2.0:1788587452.950575:0:23265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788587452.950601:0:23265:0:(import.c:65:import_set_state_nolock()) ffff8cbe04b32000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587452.950630:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf35d55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+6:2408:x1875469292163584:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 341us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587452.950637:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:2.0:1788587452.950651:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:2.0:1788587452.950655:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf10945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2408:x1875469292163712:12345-192.168.203.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788587452.950673:0:23265:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3ddd9e77-7692-4352-87e9-0155c2125e90@192.168.203.14@tcp t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:2.0:1788587452.950690:0:23265:0:(genops.c:1385:class_connect()) connect: client 3ddd9e77-7692-4352-87e9-0155c2125e90, cookie 0x419e1ae1f634573a 00002000:00100000:2.0:1788587452.950695:0:23265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3ddd9e77-7692-4352-87e9-0155c2125e90/ffff8cbe04b32800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788587452.950701:0:23265:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788587452.950776:0:23265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788587452.950824:0:23265:0:(import.c:65:import_set_state_nolock()) ffff8cbe04b36000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587452.950855:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf10945880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+6:2408:x1875469292163712:12345-192.168.203.14@tcp:8:mount.lustre.0 Request processed in 198us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587452.950862:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 21 00000100:00100000:3.0:1788587452.955335:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587452.955823:0:21959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292163968 00000100:00100000:2.0:1788587452.955835:0:21959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292163968 00000100:00100000:2.0:1788587452.955882:0:21959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:2.0:1788587452.955893:0:21959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+6:18473:x1875469292163968:12345-192.168.203.14@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788587452.955975:0:21959:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788587452.956060:0:21959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+6:18473:x1875469292163968:12345-192.168.203.14@tcp:33:mount.lustre.0 Request processed in 168us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587452.956069:0:21959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:0.0:1788587452.971188:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587452.971210:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310095232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587452.971291:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587452.971368:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310095232 00000100:00100000:0.0:1788587452.971375:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310095232 00000100:00100000:0.0:1788587452.971422:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788587452.971431:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310095232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587452.971457:0:22600:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587452.971498:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310095232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587452.971505:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788587452.971624:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310095232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788587452.972856:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587452.972873:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310095360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587452.972927:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587452.972987:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310095360 00000100:00100000:2.0:1788587452.972993:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310095360 00000100:00100000:2.0:1788587452.973041:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587452.973048:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310095360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788587452.973069:0:21960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788587452.973118:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310095360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587452.973125:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788587452.973151:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310095360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587453.098880:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587453.098982:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292164096 00000100:00100000:2.0:1788587453.098993:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292164096 00000100:00100000:2.0:1788587453.099056:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:2.0:1788587453.099067:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+6:18506:x1875469292164096:12345-192.168.203.14@tcp:101:mkdir.0 00010000:00010000:2.0:1788587453.099086:0:21956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587453.099107:0:21956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6345741 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e34 expref: -99 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587453.099167:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587453.099181:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587453.099207:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587453.099244:0:21956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587453.099249:0:21956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587453.099269:0:21956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587453.099294:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f6345741 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e34 expref: 8 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587453.099325:0:21956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e34 expref: 7 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587453.099334:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be800) 00010000:00010000:2.0:1788587453.099337:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587453.099340:0:21956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42045200, rc 0) 00000100:00100000:2.0:1788587453.099401:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+7:18506:x1875469292164096:12345-192.168.203.14@tcp:101:mkdir.0 Request processed in 335us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587453.099408:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:3.0:1788587453.483010:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310095616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587453.483081:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587453.483120:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587453.483125:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310095488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788587453.483145:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587453.483172:0:23268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310095616 00000100:00100000:3.0:1788587453.483180:0:23268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310095616 00000100:00100000:3.0:1788587453.483239:0:23268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310095488 00000100:00100000:3.0:1788587453.483243:0:23268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310095488 00000100:00100000:3.0:1788587453.483258:0:23268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587453.483265:0:23268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310095616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587453.483424:0:23268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587453.483464:0:23268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310095616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587453.483471:0:23268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587453.483487:0:23268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587453.483493:0:23268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310095488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788587453.483503:0:23268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788587453.483636:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3473:1875469310095872:0@lo:400:kworker.0 00000100:00100000:1.0:1788587453.483677:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587453.483708:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310096384:0@lo:400:kworker.0 00000100:00080000:3.0:1788587453.483742:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587453.483746:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587453.483755:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310095744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587453.483781:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587453.483828:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310096256:0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.483852:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587453.483871:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310096768:0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.483890:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587453.483918:0:24465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310095744 00000100:00100000:3.0:1788587453.483922:0:24465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310095744 00000100:00100000:3.0:1788587453.483960:0:24465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587453.483966:0:24465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310095744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788587453.483977:0:24465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587453.484006:0:24465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310095744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587453.484011:0:24465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788587453.484025:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587453.484033:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310096128:0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.484055:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587453.484070:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310096640:0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.484087:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587453.484100:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469310097152:0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.484118:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587453.484155:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310095616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587453.484174:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788587453.484179:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310096000:0@lo:400:kworker.0 00000100:00100000:2.0:1788587453.485341:0:23267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310096128 00000100:00100000:2.0:1788587453.485351:0:23267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310096128 00000100:00100000:2.0:1788587453.485760:0:23267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587453.485770:0:23267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310096128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587453.486408:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587453.486443:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469310096896:0@lo:400:kworker.0 00000100:00100000:0.0:1788587453.486471:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587453.486499:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310096384 00000100:00100000:0.0:1788587453.486504:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310096384 00000100:00100000:0.0:1788587453.486536:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788587453.486543:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310096384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587453.486580:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310096384:12345-0@lo:400:kworker.0 Request processed in 38us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587453.486587:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788587453.486625:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3bd51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310096384:0@lo:400:kworker.0 00000100:00100000:0.0:1788587453.486646:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310095872 00000100:00100000:0.0:1788587453.486650:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310095872 00000100:00100000:0.0:1788587453.486751:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788587453.486758:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:3473:x1875469310095872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587453.486791:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a966c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:3473:x1875469310095872:12345-0@lo:400:kworker.0 Request processed in 34us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587453.486827:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788587453.486863:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3473:1875469310095872:0@lo:400:kworker.0 00000100:00100000:0.0:1788587453.486923:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310096256 00000100:00100000:0.0:1788587453.486926:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310096256 00000100:00100000:0.0:1788587453.486944:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310096768 00000100:00100000:0.0:1788587453.486947:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310096768 00000100:00100000:0.0:1788587453.486960:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310096640 00000100:00100000:0.0:1788587453.486962:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310096640 00000100:00100000:0.0:1788587453.486973:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310097152 00000100:00100000:0.0:1788587453.486976:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310097152 00000100:00100000:0.0:1788587453.486989:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310096896 00000100:00100000:0.0:1788587453.486991:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310096896 00000100:00100000:0.0:1788587453.487003:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587453.487009:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310096256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587453.487043:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310096256:12345-0@lo:400:kworker.0 Request processed in 34us (3190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587453.487049:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788587453.487061:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587453.487066:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310096768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587453.487092:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310096768:12345-0@lo:400:kworker.0 Request processed in 26us (3200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587453.487097:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788587453.487108:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788587453.487113:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310096640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587453.487137:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310096640:12345-0@lo:400:kworker.0 Request processed in 24us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587453.487143:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788587453.487161:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788587453.487167:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469310097152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587453.487195:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469310097152:12345-0@lo:400:kworker.0 Request processed in 29us (3076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587453.487215:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788587453.487226:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788587453.487232:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469310096896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587453.487262:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469310096896:12345-0@lo:400:kworker.0 Request processed in 31us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587453.487264:0:23267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310096128:12345-0@lo:400:kworker.0 Request processed in 1496us (3207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587453.487268:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788587453.487271:0:23267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788587453.487293:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2ed80 x1875469310096896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587453.487303:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469310096896:0@lo:400:kworker.0 00000100:00080000:2.0:1788587453.487352:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788587453.487356:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587453.487358:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587453.487385:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310095744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587453.487398:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310096256:0@lo:400:kworker.0 00000100:00100000:2.0:1788587453.487407:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310096768:0@lo:400:kworker.0 00000100:00100000:2.0:1788587453.487444:0:23268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310095488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3951us (4298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587453.487451:0:23268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587453.488388:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587453.488423:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310096000 00000100:00100000:3.0:1788587453.488429:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310096000 00000100:00100000:3.0:1788587453.488462:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788587453.488476:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310096000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.488521:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310096000:12345-0@lo:400:kworker.0 Request processed in 46us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587453.488528:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788587453.488564:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310096000:0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.488574:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310096512:0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.488607:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587453.488632:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469310097024:0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.488653:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587453.488673:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310097024 00000100:00100000:3.0:1788587453.488676:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310097024 00000100:00100000:3.0:1788587453.488707:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788587453.488713:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469310097024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.488739:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469310097024:12345-0@lo:400:kworker.0 Request processed in 27us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587453.488745:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788587453.488758:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587453.488777:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469310097024:0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.488788:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310096128:0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.488821:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310096640:0@lo:400:kworker.0 00010000:00080000:3.0:1788587453.488832:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf41a2f100 x1875469310097152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587453.488840:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469310097152:0@lo:400:kworker.0 00000100:00100000:3.0:1788587453.488868:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310095488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587453.489692:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310096512 00000100:00100000:1.0:1788587453.489699:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310096512 00000100:00100000:1.0:1788587453.489735:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587453.489742:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310096512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587453.489788:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310096512:12345-0@lo:400:kworker.0 Request processed in 47us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587453.490223:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587453.490652:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310096512:0@lo:400:kworker.0 00000001:00100000:2.0:1788587453.534528:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bc3138d6-3c05-4ca5-96dc-2f3434542c99 00000001:00100000:2.0:1788587453.534549:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ddd9e77-7692-4352-87e9-0155c2125e90 00000001:00100000:0.0:1788587453.537519:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bc3138d6-3c05-4ca5-96dc-2f3434542c99 00000001:00100000:0.0:1788587453.537556:0:7270:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3ddd9e77-7692-4352-87e9-0155c2125e90 00010000:00010000:2.0:1788587453.675758:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587454.699108:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587455.656291:0:8130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ddd9e77-7692-4352-87e9-0155c2125e90 00010000:00010000:2.0:1788587455.725583:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587456.043315:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587456.043335:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310097280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587456.043402:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587456.043445:0:24465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310097280 00000100:00100000:0.0:1788587456.043452:0:24465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310097280 00000100:00100000:0.0:1788587456.043516:0:24465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587456.043527:0:24465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310097280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587456.043561:0:24465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788587456.043605:0:24465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310097280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587456.043624:0:24465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788587456.043645:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587456.043680:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310097280:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788587456.060919:0:24558:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788587456.750769:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587457.071249:0:21990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1788587457.629364:0:9072:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ddd9e77-7692-4352-87e9-0155c2125e90 00010000:00010000:2.0:1788587457.773556:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587458.093670:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587458.093692:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310097408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587458.093759:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587458.093829:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310097408 00000100:00100000:3.0:1788587458.093837:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310097408 00000100:00100000:3.0:1788587458.093890:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788587458.093899:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310097408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788587458.093935:0:22600:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788587458.093994:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310097408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587458.094002:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788587458.094140:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310097408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788587458.097927:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587458.098195:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310097536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788587458.098259:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587458.098360:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310097536 00000100:00100000:2.0:1788587458.098367:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310097536 00000100:00100000:2.0:1788587458.098420:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788587458.098429:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310097536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788587458.098467:0:21961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587458.098532:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310097536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587458.098549:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788587458.098682:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310097536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587458.200657:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587458.200698:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587458.200759:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292164352 00000100:00100000:2.0:1788587458.200769:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292164352 00000100:00100000:1.0:1788587458.200782:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587458.200818:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587458.200853:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292164864 00000100:00100000:2.0:1788587458.200856:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292164864 00000100:00100000:2.0:1788587458.200881:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:2.0:1788587458.200890:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:2409:x1875469292164352:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587458.200959:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:2409:x1875469292164352:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 70us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587458.200966:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:2.0:1788587458.200982:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:2.0:1788587458.200987:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+6:2409:x1875469292164864:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:2.0:1788587458.201009:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+6:2409:x1875469292164864:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 22us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587458.201015:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:1.0:1788587458.205359:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587458.205468:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587458.205494:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587458.208997:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292164608 00000100:00100000:0.0:1788587458.209013:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292164608 00000100:00100000:0.0:1788587458.209079:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292165120 00000100:00100000:0.0:1788587458.209083:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292165120 00000100:00100000:0.0:1788587458.209121:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:0.0:1788587458.209131:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2409:x1875469292164608:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587458.209273:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2409:x1875469292164608:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 142us (8573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587458.209291:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:0.0:1788587458.209310:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:0.0:1788587458.209837:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292165120:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587458.209872:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292165120:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 556us (9053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587458.209879:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00080000:0.0:1788587458.209902:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587458.209906:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587458.211049:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292164736 00000100:00100000:1.0:1788587458.211058:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292164736 00000100:00100000:1.0:1788587458.211100:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:1.0:1788587458.211109:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2409:x1875469292164736:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587458.211151:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2409:x1875469292164736:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 43us (5656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.211166:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:1.0:1788587458.211201:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292164480 00000100:00100000:1.0:1788587458.211205:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292164480 00000100:00100000:1.0:1788587458.211233:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:1.0:1788587458.211239:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2409:x1875469292164480:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587458.211266:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2409:x1875469292164480:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 27us (5799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.211272:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:1.0:1788587458.211339:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00080000:0.0:1788587458.211459:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788587458.211469:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587458.211714:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292164224 00000100:00100000:1.0:1788587458.211718:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292164224 00000100:00100000:1.0:1788587458.211835:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00100000:1.0:1788587458.211844:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:2409:x1875469292164224:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587458.211876:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:2409:x1875469292164224:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 34us (6535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.211882:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 144 00000100:00100000:1.0:1788587458.211907:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292164992 00000100:00100000:1.0:1788587458.211911:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292164992 00000100:00100000:1.0:1788587458.211942:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:1.0:1788587458.211949:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292164992:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587458.211972:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292164992:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.211979:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00080000:0.0:1788587458.212220:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587458.212253:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587458.212327:0:23267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292165248 00000100:00100000:1.0:1788587458.212331:0:23267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292165248 00000100:00080000:0.0:1788587458.212583:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587458.212706:0:23267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:1.0:1788587458.212714:0:23267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292165248:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587458.212897:0:23267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292165248:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 182us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.212904:0:23267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:1.0:1788587458.603590:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310097664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788587458.603654:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.603685:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310098176:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.603708:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.603726:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310098688:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.603745:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.603760:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469310099200:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.603788:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.603824:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788587458.603830:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310098048:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.603850:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.603866:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310098560:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.603901:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.603918:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469310099072:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.603937:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.603966:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310097792:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.603991:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.604020:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310098304:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604049:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.604078:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310098816:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604099:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.604115:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310099328:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604133:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.604145:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788587458.604151:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310097920:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604172:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.604189:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310098432:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604209:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.604225:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310098944:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604244:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.604270:0:24058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310098176 00000100:00100000:1.0:1788587458.604289:0:24058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310098176 00000100:00100000:1.0:1788587458.604350:0:24058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310098688 00000100:00100000:1.0:1788587458.604353:0:24058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310098688 00000100:00100000:1.0:1788587458.604367:0:24058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310098048 00000100:00100000:1.0:1788587458.604370:0:24058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310098048 00000100:00100000:1.0:1788587458.604382:0:24058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310098560 00000100:00100000:1.0:1788587458.604385:0:24058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310098560 00000100:00100000:1.0:1788587458.604399:0:24058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587458.604407:0:24058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310098176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604457:0:24058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310098176:12345-0@lo:400:kworker.0 Request processed in 50us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.604463:0:24058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587458.604479:0:24058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587458.604485:0:24058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310098688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604513:0:24058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310098688:12345-0@lo:400:kworker.0 Request processed in 29us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.604525:0:24058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587458.604537:0:24058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587458.604542:0:24058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310098048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604571:0:24058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310098048:12345-0@lo:400:kworker.0 Request processed in 30us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.604577:0:24058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587458.604587:0:24058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587458.604593:0:24058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310098560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604615:0:24058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310098560:12345-0@lo:400:kworker.0 Request processed in 23us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.604620:0:24058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788587458.604640:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310099200 00000100:00100000:1.0:1788587458.604644:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310099200 00000100:00100000:1.0:1788587458.604668:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310099072 00000100:00100000:1.0:1788587458.604671:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310099072 00000100:00100000:1.0:1788587458.604681:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310098304 00000100:00100000:1.0:1788587458.604683:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310098304 00000100:00100000:1.0:1788587458.604691:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310098816 00000100:00100000:1.0:1788587458.604694:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310098816 00000100:00100000:1.0:1788587458.604701:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310099328 00000100:00100000:1.0:1788587458.604703:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310099328 00000100:00100000:1.0:1788587458.604712:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310098944 00000100:00100000:1.0:1788587458.604715:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310098944 00000100:00100000:1.0:1788587458.604725:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587458.604731:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469310099200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604758:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469310099200:12345-0@lo:400:kworker.0 Request processed in 27us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.604764:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587458.604781:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587458.604787:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469310099072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604837:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3475:x1875469310099072:12345-0@lo:400:kworker.0 Request processed in 50us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.604844:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587458.604855:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788587458.604860:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310098304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604891:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3472:x1875469310098304:12345-0@lo:400:kworker.0 Request processed in 30us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.604897:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788587458.604907:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788587458.604913:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310098816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604938:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3472:x1875469310098816:12345-0@lo:400:kworker.0 Request processed in 27us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.604944:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788587458.604954:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788587458.604960:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310099328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.604983:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3472:x1875469310099328:12345-0@lo:400:kworker.0 Request processed in 24us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.604988:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788587458.604997:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788587458.605003:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310098944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.605026:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3472:x1875469310098944:12345-0@lo:400:kworker.0 Request processed in 24us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.605032:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788587458.605072:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788587458.605077:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587458.605079:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587458.605081:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587458.605110:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3472:1875469310098944:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.605122:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3472:1875469310098304:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.605131:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3472:1875469310098816:0@lo:400:kworker.0 00010000:00080000:1.0:1788587458.605142:0:3472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3cc5c000 x1875469310099328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587458.605152:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3472:1875469310099328:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.605197:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310098048:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.605207:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310098560:0@lo:400:kworker.0 00010000:00080000:1.0:1788587458.605218:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf3cc5c700 x1875469310099072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587458.605227:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3475:1875469310099072:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.605241:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310098176:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.605255:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310098688:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.605265:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469310099200:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.605331:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310097792 00000100:00100000:1.0:1788587458.605335:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310097792 00000100:00100000:1.0:1788587458.605363:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788587458.605369:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3a965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:3472:x1875469310097792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.605418:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3a965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:3472:x1875469310097792:12345-0@lo:400:kworker.0 Request processed in 49us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.605425:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788587458.605462:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310097792:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.605474:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587458.605484:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310099456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587458.605512:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587458.605537:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310099584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587458.605548:0:24465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310097664 00000100:00100000:1.0:1788587458.605553:0:24465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310097664 00000100:00100000:1.0:1788587458.605577:0:24465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310099456 00000100:00100000:1.0:1788587458.605580:0:24465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310099456 00000100:00100000:1.0:1788587458.605590:0:24465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587458.605597:0:24465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310097664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788587458.605621:0:24465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587458.605706:0:23268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587458.605716:0:23268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310099456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788587458.605733:0:23268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788587458.610003:0:24465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310097664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4394us (6337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.610079:0:24465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788587458.610197:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310097920 00000100:00100000:1.0:1788587458.610205:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310097920 00000100:00100000:1.0:1788587458.610238:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310098432 00000100:00100000:1.0:1788587458.610240:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310098432 00000100:00100000:1.0:1788587458.610254:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587458.610260:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310097920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.610333:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3472:x1875469310097920:12345-0@lo:400:kworker.0 Request processed in 72us (6159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.610339:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587458.610351:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788587458.611318:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587458.611574:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310098432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.611632:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310098432:12345-0@lo:400:kworker.0 Request processed in 1265us (7421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587458.611640:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788587458.611665:0:24465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310099584 00000100:00100000:3.0:1788587458.611673:0:24465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310099584 00000100:00100000:1.0:1788587458.611696:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3472:1875469310097920:0@lo:400:kworker.0 00000100:00100000:1.0:1788587458.611710:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310098432:0@lo:400:kworker.0 00000100:00100000:3.0:1788587458.611717:0:24465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788587458.611727:0:24465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310099584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587458.611745:0:24465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587458.611775:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf41a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310097664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788587458.611810:0:24465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310099584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587458.611817:0:24465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788587458.611849:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310099584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587458.615996:0:23268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310099456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10270us (10472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587458.616009:0:23268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587458.616213:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf34a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310099456:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788587458.797153:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587459.180105:0:22612:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1788587459.458773:0:24710:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7cbb0ad0 20000000:00000080:0.0:1788587459.458989:0:24710:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbe05799800 uarg=0000000000000000 20000000:01000000:0.0:1788587459.459028:0:24710:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788587459.459034:0:24710:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788587459.459039:0:24710:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788587459.460399:0:24711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788587459.460685:0:24710:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788587459.473997:0:24710:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788587459.474193:0:24710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474214:0:24710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe05f27400/0x419e1ae1f63453ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63453a5 expref: 23 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474223:0:24710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf40c19a00/0x419e1ae1f63453ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63453b3 expref: 23 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474229:0:24710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63453f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63453f2 expref: 23 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474234:0:24710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f634556c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345565 expref: 23 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474245:0:24710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63456df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d93 expref: 12 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474279:0:24710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634571e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e03 expref: 12 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474287:0:24710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474328:0:24710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634571e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e03 expref: 12 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474342:0:24710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634571e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e03 expref: 12 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587459.474359:0:24710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c19500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310099712:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587459.474460:0:24710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63456df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d93 expref: 12 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474468:0:24710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63456df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d93 expref: 12 pid: 21948 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587459.474476:0:24710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310099840:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587459.474518:0:24710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f634556c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f6345565 expref: 23 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474527:0:24710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f634556c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f6345565 expref: 23 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587459.474535:0:24710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310099968:0@lo:104: 00000100:00100000:1.0:1788587459.474585:0:24710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587459.474634:0:24710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63453f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63453f2 expref: 23 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474642:0:24710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63453f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63453f2 expref: 23 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587459.474650:0:24710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310100096:0@lo:104: 00000100:00100000:1.0:1788587459.474669:0:24710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587459.474689:0:24710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbf40c19a00/0x419e1ae1f63453ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63453b3 expref: 23 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474697:0:24710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbf40c19a00/0x419e1ae1f63453ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63453b3 expref: 23 pid: 21948 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587459.474704:0:24710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310100224:0@lo:104: 00000100:00100000:1.0:1788587459.474722:0:24710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587459.474738:0:24710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe05f27400/0x419e1ae1f63453ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x419e1ae1f63453a5 expref: 23 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.474745:0:24710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe05f27400/0x419e1ae1f63453ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x419e1ae1f63453a5 expref: 23 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587459.474752:0:24710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310100352:0@lo:104: 00000100:00100000:1.0:1788587459.474768:0:24710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587459.474777:0:24710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf2042b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587459.474989:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310099968 00000100:00100000:0.0:1788587459.474997:0:21938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310099968 00000100:00100000:0.0:1788587459.475033:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310100096 00000100:00100000:0.0:1788587459.475036:0:21938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310100096 00000100:00100000:0.0:1788587459.475045:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310100224 00000100:00100000:0.0:1788587459.475047:0:21938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310100224 00000100:00100000:0.0:1788587459.475055:0:21938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310100352 00000100:00100000:0.0:1788587459.475057:0:21938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310100352 00000100:00100000:0.0:1788587459.475068:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587459.475076:0:21938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+6:24710:x1875469310099968:12345-0@lo:104: 00010000:00010000:0.0:1788587459.475089:0:21938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475141:0:21938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587459.475147:0:21938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+6:24710:x1875469310099968:12345-0@lo:104: Request processed in 71us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587459.475153:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587459.475178:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587459.475184:0:21938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+5:24710:x1875469310100096:12345-0@lo:104: 00010000:00010000:0.0:1788587459.475200:0:21938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475233:0:21938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788587459.475238:0:21938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+5:24710:x1875469310100096:12345-0@lo:104: Request processed in 55us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587459.475245:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587459.475257:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587459.475263:0:21938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+4:24710:x1875469310100224:12345-0@lo:104: 00010000:00010000:0.0:1788587459.475278:0:21938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475311:0:21938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788587459.475316:0:21938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+4:24710:x1875469310100224:12345-0@lo:104: Request processed in 54us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587459.475321:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587459.475332:0:21938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587459.475339:0:21938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf41a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:24710:x1875469310100352:12345-0@lo:104: 00010000:00010000:0.0:1788587459.475346:0:21938:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475369:0:21938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788587459.475374:0:21938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf41a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+3:24710:x1875469310100352:12345-0@lo:104: Request processed in 37us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587459.475380:0:21938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788587459.475398:0:24062:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788587459.475404:0:24062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475415:0:24062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044c00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587459.475419:0:24062:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475427:0:24062:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587459.475434:0:24062:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587459.475440:0:24062:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587459.475467:0:24062:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475473:0:24062:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587459.475493:0:24062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475500:0:24062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf42044c00/0x419e1ae1f6345565 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f634556c expref: -99 pid: 23983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475512:0:24062:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788587459.475515:0:24062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475521:0:24062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482600 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587459.475524:0:24062:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475541:0:24062:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587459.475547:0:24062:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587459.475553:0:24062:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587459.475565:0:24062:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475571:0:24062:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587459.475585:0:24062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475592:0:24062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf03482600/0x419e1ae1f63453f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63453f9 expref: -99 pid: 23263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475601:0:24062:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587459.475604:0:24062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475610:0:24062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c18e00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587459.475613:0:24062:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475620:0:24062:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587459.475626:0:24062:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587459.475637:0:24062:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587459.475651:0:24062:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475657:0:24062:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587459.475664:0:24062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475670:0:24062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf40c18e00/0x419e1ae1f63453b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63453ba expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475679:0:24062:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587459.475682:0:24062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475687:0:24062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ea00 already unused, calling callback (ffffffffc1cf1c20) 10000000:00010000:0.0:1788587459.475690:0:24062:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475696:0:24062:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587459.475701:0:24062:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587459.475706:0:24062:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788587459.475717:0:24062:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475723:0:24062:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587459.475736:0:24062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475742:0:24062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.114@tcp lock: ffff8cbf0499ea00/0x419e1ae1f63453a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x419e1ae1f63453ac expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.475755:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587459.475757:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587459.475759:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587459.475765:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587459.475770:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587459.475787:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3475:1875469310100480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587459.475844:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587459.475867:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587459.475872:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3475:1875469310100864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587459.475892:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587459.475917:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310100608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587459.475951:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587459.475971:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587459.475977:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310100736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587459.475997:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587459.476019:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310100480 00000100:00100000:0.0:1788587459.476023:0:21942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310100480 00010000:00010000:0.0:1788587459.476045:0:21942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f634556c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345565 expref: 24 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587459.476061:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310100864 00000100:00100000:0.0:1788587459.476064:0:21942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310100864 00010000:00010000:0.0:1788587459.476075:0:21942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe05f27400/0x419e1ae1f63453ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63453a5 expref: 25 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587459.476093:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310100608 00000100:00100000:0.0:1788587459.476096:0:21942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310100608 00010000:00010000:0.0:1788587459.476107:0:21942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63453f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63453f2 expref: 26 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587459.476117:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310100736 00000100:00100000:0.0:1788587459.476119:0:21942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310100736 00010000:00010000:0.0:1788587459.476127:0:21942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf40c19a00/0x419e1ae1f63453ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63453b3 expref: 27 pid: 21948 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587459.476138:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587459.476144:0:21942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+27:3475:x1875469310100480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587459.476153:0:21942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587459.476158:0:21942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f634556c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f6345565 expref: 27 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.476167:0:21942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f634556c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f6345565 expref: 27 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.476182:0:21942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587459.476210:0:21942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe03d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+27:3475:x1875469310100480:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587459.476216:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788587459.476229:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587459.476234:0:21942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3bd51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+26:3475:x1875469310100864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587459.476252:0:21942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587459.476258:0:21942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe05f27400/0x419e1ae1f63453ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63453a5 expref: 26 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.476288:0:21942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe05f27400/0x419e1ae1f63453ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63453a5 expref: 26 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.476298:0:21942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587459.476322:0:21942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3bd51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+26:3475:x1875469310100864:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587459.476329:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587459.476342:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587459.476348:0:21942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+25:3472:x1875469310100608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587459.476356:0:21942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587459.476360:0:21942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63453f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63453f2 expref: 25 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.476369:0:21942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63453f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63453f2 expref: 25 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.476377:0:21942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587459.476401:0:21942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+25:3472:x1875469310100608:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587459.476407:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587459.476418:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587459.476424:0:21942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:3472:x1875469310100736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587459.476430:0:21942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587459.476434:0:21942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf40c19a00/0x419e1ae1f63453ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x419e1ae1f63453b3 expref: 24 pid: 21948 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.476442:0:21942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf40c19a00/0x419e1ae1f63453ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x419e1ae1f63453b3 expref: 24 pid: 21948 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.476457:0:21942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587459.476480:0:21942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:3472:x1875469310100736:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587459.476486:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788587459.476523:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3475:1875469310100864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587459.476531:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3475:1875469310100480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587459.476557:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310100736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587459.476564:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe03d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3472:1875469310100608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587459.477663:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cce00/0x419e1ae1f634556c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f6345565 expref: 23 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587459.477718:0:24710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310099968:0@lo:104: 00010000:00010000:1.0:1788587459.477731:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf0499fc00/0x419e1ae1f63453f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63453f2 expref: 22 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587459.477750:0:24710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310100096:0@lo:104: 00010000:00010000:1.0:1788587459.477762:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf40c19a00/0x419e1ae1f63453ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63453b3 expref: 21 pid: 21948 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587459.477770:0:24710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310100224:0@lo:104: 00010000:00010000:1.0:1788587459.477777:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe05f27400/0x419e1ae1f63453ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x419e1ae1f63453a5 expref: 20 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587459.477790:0:24710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310100352:0@lo:104: 00000100:00100000:1.0:1788587459.490302:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587459.490393:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587459.490400:0:24710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c19500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310099712:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587459.490412:0:24710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24710:1875469310099840:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587459.490461:0:24710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587459.490520:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292165376 00000100:00100000:0.0:1788587459.490527:0:21942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292165376 00010000:00010000:0.0:1788587459.490560:0:21942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634571e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e03 expref: 13 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587459.490604:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292165504 00000100:00100000:0.0:1788587459.490608:0:21942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292165504 00010000:00010000:0.0:1788587459.490620:0:21942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63456df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d93 expref: 14 pid: 21948 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587459.490633:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:0.0:1788587459.490640:0:21942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf33bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+14:2409:x1875469292165376:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587459.490654:0:21942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587459.490659:0:21942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634571e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e03 expref: 14 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490668:0:21942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634571e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e03 expref: 14 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490693:0:21942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cc200/0x419e1ae1f634571e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e03 expref: 14 pid: 21947 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490707:0:21942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587459.490761:0:21942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf33bbf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:2409:x1875469292165376:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 120us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587459.490769:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 13 00000100:00100000:0.0:1788587459.490838:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 14 00000100:00100000:0.0:1788587459.490845:0:21942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+12:2409:x1875469292165504:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587459.490853:0:21942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587459.490857:0:21942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63456df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d93 expref: 12 pid: 21948 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490865:0:21942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63456df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d93 expref: 12 pid: 21948 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490875:0:21942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf42044e00/0x419e1ae1f63456df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5d93 expref: 12 pid: 21948 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490886:0:21942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490894:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490908:0:21942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490925:0:21942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490932:0:21942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490939:0:21942:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490945:0:21942:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587459.490949:0:21942:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490957:0:21942:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490977:0:21942:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.490987:0:21942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587459.491014:0:21942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:2409:x1875469292165504:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 169us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587459.491021:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 14 00010000:00010000:1.0:1788587459.491281:0:24710:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.491311:0:24710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587459.491318:0:24710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbf421cd000/0x419e1ae1f634574f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587459.820226:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587460.762508:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587460.762913:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292165632 00000100:00100000:2.0:1788587460.762924:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292165632 00000100:00080000:1.0:1788587460.762986:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587460.763000:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:2.0:1788587460.763013:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:18973:x1875469292165632:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587460.763034:0:23996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587460.763056:0:23996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044600/0x419e1ae1f6345756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e3b expref: -99 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763131:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f634575d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763147:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f634575d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763160:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f634575d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763175:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6345764 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763182:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6345764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763188:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6345764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763502:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f634576b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763523:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f634576b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763531:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f634576b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587460.763557:0:23996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587460.763560:0:23996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587460.763596:0:23996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f634576b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763606:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f634575d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763612:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f634575d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763618:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f634575d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763624:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587460.763629:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f634575d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763636:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f634575d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763648:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be800) 00010000:00010000:2.0:1788587460.763651:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587460.763655:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f634575d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763670:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f634575d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763683:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6345764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763694:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6345764 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763700:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6345764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763704:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587460.763707:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6345764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763713:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6345764 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763721:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cbf20ad1300) 00010000:00010000:2.0:1788587460.763723:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587460.763726:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6345764 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763731:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044c00/0x419e1ae1f6345764 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763763:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044600/0x419e1ae1f6345756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e3b expref: 8 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763790:0:23996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045800/0x419e1ae1f634576b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e3b expref: 7 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.763846:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbf20ad1500) 00010000:00010000:2.0:1788587460.763848:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587460.763850:0:23996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42045800, rc 0) 00000100:00100000:2.0:1788587460.763914:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:18973:x1875469292165632:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 904us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587460.763922:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:0.0:1788587460.769193:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587460.769525:0:21967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292165760 00000100:00100000:1.0:1788587460.769536:0:21967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292165760 00000100:00100000:1.0:1788587460.769594:0:21967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:1.0:1788587460.769605:0:21967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:18973:x1875469292165760:12345-192.168.203.14@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788587460.769687:0:21967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:18973:x1875469292165760:12345-192.168.203.14@tcp:900:lhsmtool_posix.0 Request processed in 84us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587460.769708:0:21967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:3.0:1788587460.778922:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587460.779157:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292166016 00000100:00100000:1.0:1788587460.779167:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292166016 00000100:00100000:1.0:1788587460.779237:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:1.0:1788587460.779248:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:18973:x1875469292166016:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587460.779277:0:21957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587460.779299:0:21957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345772 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e42 expref: -99 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.779369:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345779 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.779383:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345779 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.779394:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345779 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.779408:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345780 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.779415:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345780 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.779421:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345780 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.779936:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6345787 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.779957:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6345787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.779965:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6345787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587460.779975:0:21957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788587460.780161:0:21957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345779 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.780169:0:21957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345779 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.780176:0:21957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345779 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.780182:0:21957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587460.780186:0:21957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345779 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.780193:0:21957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345779 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.780205:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbf20ad1500) 00010000:00010000:1.0:1788587460.781158:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587460.781169:0:21957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345779 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.781179:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345779 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.781199:0:21957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345780 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.781554:0:21957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345780 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.781613:0:21957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345780 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.781618:0:21957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587460.781623:0:21957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345780 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.781630:0:21957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345780 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.781642:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cbf02c72200) 00010000:00010000:1.0:1788587460.781645:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587460.781648:0:21957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345780 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.781654:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345780 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.782470:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345772 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e42 expref: 10 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.782503:0:21957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cca00/0x419e1ae1f6345787 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e42 expref: 9 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.782511:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf02c72100) 00010000:00010000:1.0:1788587460.782513:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587460.782521:0:21957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cca00, rc 0) 00000100:00100000:1.0:1788587460.783031:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+9:18973:x1875469292166016:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 3781us (4115us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788587460.783041:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 24 00000100:00100000:2.0:1788587460.805775:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587460.806114:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292166144 00000100:00100000:3.0:1788587460.806124:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292166144 00000100:00100000:3.0:1788587460.806660:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:3.0:1788587460.806673:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+9:18973:x1875469292166144:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788587460.807716:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+9:18973:x1875469292166144:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 Request processed in 1040us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587460.807728:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:0.0:1788587460.825153:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587460.825338:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292166272 00000100:00100000:2.0:1788587460.825348:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292166272 00000100:00100000:2.0:1788587460.825418:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:2.0:1788587460.825429:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:18973:x1875469292166272:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788587460.826016:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788587460.826940:0:21955:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1452us 00010000:00010000:0.0:1788587460.843439:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587460.849672:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587460.850574:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292166400 00000100:00100000:3.0:1788587460.850585:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292166400 00000100:00100000:3.0:1788587460.850645:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:3.0:1788587460.850656:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+9:18979:x1875469292166400:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587460.850675:0:23996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587460.850698:0:23996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f6345795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e49 expref: -99 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.850761:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f634579c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.850776:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f634579c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.850789:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f634579c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.850875:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.850884:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.850891:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851084:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f634579c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851093:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f634579c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851100:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f634579c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851106:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587460.851111:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f634579c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851118:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f634579c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851131:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be800) 00010000:00010000:3.0:1788587460.851134:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587460.851138:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f634579c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851145:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f634579c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851163:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851169:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851175:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851187:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587460.851190:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851197:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851205:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cbf02c76700) 00010000:00010000:3.0:1788587460.851208:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587460.851211:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851217:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851253:0:23996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f6345795 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e49 expref: 10 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851277:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be800) 00010000:00010000:3.0:1788587460.851279:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587460.851283:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f6345795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e49 expref: 10 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.851294:0:23996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26a00, rc 0) 00000100:00100000:3.0:1788587460.851373:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+9:18979:x1875469292166400:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 719us (1708us total) trans 0 rc 301/301 00000100:00100000:3.0:1788587460.851380:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:1.0:1788587460.857991:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587460.858077:0:21964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292166528 00000100:00100000:3.0:1788587460.858098:0:21964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292166528 00000100:00100000:3.0:1788587460.858150:0:21964:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:3.0:1788587460.858161:0:21964:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+9:18979:x1875469292166528:12345-192.168.203.14@tcp:700:lfs.0 00000100:00100000:3.0:1788587460.858241:0:21964:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+9:18979:x1875469292166528:12345-192.168.203.14@tcp:700:lfs.0 Request processed in 82us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587460.858249:0:21964:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:3.0:1788587460.861368:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587460.861508:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292166784 00000100:00100000:1.0:1788587460.861516:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292166784 00000100:00100000:1.0:1788587460.861565:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:1.0:1788587460.861575:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+9:18979:x1875469292166784:12345-192.168.203.14@tcp:36:lfs.0 00010000:00010000:1.0:1788587460.861621:0:21957:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587460.861645:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345709 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5dc4 expref: 9 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.861664:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be800) 00010000:00010000:1.0:1788587460.861669:0:21957:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587460.862046:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.862062:0:21957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e34 expref: 5 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.862072:0:21957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.862111:0:21957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e34 expref: 5 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.862134:0:21957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e34 expref: 5 pid: 21956 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587460.862148:0:21957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21957:1875469310100992:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587460.862241:0:21957:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf057b2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587460.866953:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:18973:x1875469292166272:12345-192.168.203.14@tcp:59:lhsmtool_posix.0 Request processed in 41515us (41799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587460.866967:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:2.0:1788587460.870396:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587460.870442:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292166912 00000100:00100000:0.0:1788587460.870453:0:21942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292166912 00010000:00010000:0.0:1788587460.870531:0:21942:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e34 expref: 6 pid: 21956 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587460.870569:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:0.0:1788587460.870580:0:21942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+6:2410:x1875469292166912:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587460.870594:0:21942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587460.870601:0:21942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e34 expref: 6 pid: 21956 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587460.870614:0:21942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e34 expref: 6 pid: 21956 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587460.870637:0:21942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be800) 00010000:00010000:0.0:1788587460.870642:0:21942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587460.870652:0:21942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587460.870660:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587460.870679:0:21942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587460.870726:0:21942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+6:2410:x1875469292166912:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 147us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587460.870734:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00080000:2.0:1788587460.870970:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587460.871896:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f6345748 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e34 expref: 5 pid: 21956 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587460.871918:0:21957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:21957:1875469310100992:192.168.203.14@tcp:104: 00010000:00010000:3.0:1788587460.871941:0:21957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.871952:0:21957:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.871959:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.871983:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.871993:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.872002:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873414:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873434:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873445:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587460.873461:0:21957:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5bb75d9 reply state 00000000196d1fe7 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873472:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873479:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:3.0:1788587460.873482:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587460.873486:0:21957:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788587460.873491:0:21957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788587460.873498:0:21957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873505:0:21957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873511:0:21957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873517:0:21957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587460.873521:0:21957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873529:0:21957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873547:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf2c8be800) 00010000:00010000:3.0:1788587460.873550:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587460.873554:0:21957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873560:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63457aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587460.873576:0:21957:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5bb75d9 reply state 00000000196d1fe7 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873583:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587460.873588:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cbf02c76700) 00010000:00010000:3.0:1788587460.873591:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788587460.873592:0:21957:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788587460.873679:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+10:18979:x1875469292166784:12345-192.168.203.14@tcp:36:lfs.0 Request processed in 12102us (12314us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788587460.873687:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 28 00000100:00100000:2.0:1788587460.972955:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587460.973045:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292167040 00000100:00100000:1.0:1788587460.973055:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292167040 00000100:00100000:1.0:1788587460.973109:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:1.0:1788587460.973119:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+10:18987:x1875469292167040:12345-192.168.203.14@tcp:101:lctl.0 00010000:00010000:1.0:1788587460.973140:0:21956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587460.973161:0:21956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cdc00/0x419e1ae1f63457bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e50 expref: -99 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.973224:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc800/0x419e1ae1f63457c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.973239:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc800/0x419e1ae1f63457c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.973251:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc800/0x419e1ae1f63457c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587460.973292:0:21956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587460.973296:0:21956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587460.973328:0:21956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc800/0x419e1ae1f63457c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.973353:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cdc00/0x419e1ae1f63457bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e50 expref: 12 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.973390:0:21956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc800/0x419e1ae1f63457c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e50 expref: 11 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587460.973398:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c72200) 00010000:00010000:1.0:1788587460.973401:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587460.973404:0:21956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cc800, rc 0) 00000100:00100000:1.0:1788587460.973477:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+11:18987:x1875469292167040:12345-192.168.203.14@tcp:101:lctl.0 Request processed in 352us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587460.973484:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 29 00000100:00100000:1.0:1788587460.997381:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587460.997475:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292167168 00000100:00100000:2.0:1788587460.997485:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292167168 00000100:00100000:2.0:1788587460.997546:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:2.0:1788587460.997558:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+5:18988:x1875469292167168:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:2.0:1788587460.997584:0:21955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587460.997617:0:21955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63457cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e57 expref: -99 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.997677:0:21955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f63457d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.997701:0:21955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f63457d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.997714:0:21955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f63457d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587460.997747:0:21955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587460.997751:0:21955:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1788587460.997768:0:21955:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f63457d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.997791:0:21955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63457cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e57 expref: 7 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.997836:0:21955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42045200/0x419e1ae1f63457d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e57 expref: 6 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587460.997844:0:21955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c72200) 00010000:00010000:2.0:1788587460.997847:0:21955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587460.997851:0:21955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42045200, rc 0) 00000100:00100000:2.0:1788587460.997916:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+6:18988:x1875469292167168:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 360us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587460.997924:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 30 00000100:00100000:0.0:1788587461.003981:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.004068:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292167296 00000100:00100000:1.0:1788587461.004078:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292167296 00000100:00100000:1.0:1788587461.004136:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:1.0:1788587461.004146:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+6:18988:x1875469292167296:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587461.004167:0:21956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587461.004187:0:21956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cdc00/0x419e1ae1f63457db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e5e expref: -99 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004249:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f63457e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004272:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f63457e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004294:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f63457e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004323:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f63457e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004330:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f63457e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004336:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f63457e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004415:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63457f0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004423:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63457f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004429:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63457f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587461.004458:0:21956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587461.004462:0:21956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587461.004483:0:21956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63457f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004495:0:21956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f63457e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004502:0:21956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f63457e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004508:0:21956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f63457e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004523:0:21956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587461.004528:0:21956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f63457e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004536:0:21956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f63457e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004548:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c72200) 00010000:00010000:1.0:1788587461.004552:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587461.004556:0:21956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f63457e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004562:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f63457e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004577:0:21956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f63457e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004583:0:21956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f63457e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004589:0:21956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f63457e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004594:0:21956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587461.004597:0:21956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f63457e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004603:0:21956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f63457e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004622:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cbf02c76700) 00010000:00010000:1.0:1788587461.004625:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587461.004628:0:21956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f63457e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004635:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f63457e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004661:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cdc00/0x419e1ae1f63457db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e5e expref: 8 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004676:0:21956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63457f0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e5e expref: 7 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.004683:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:1.0:1788587461.004685:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587461.004688:0:21956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cd000, rc 0) 00000100:00100000:1.0:1788587461.004758:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+7:18988:x1875469292167296:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 613us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.004766:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 31 00000100:00100000:0.0:1788587461.006939:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.007014:0:21967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292167424 00000100:00100000:1.0:1788587461.007024:0:21967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292167424 00000100:00100000:1.0:1788587461.007085:0:21967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:1.0:1788587461.007095:0:21967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ddd9e77-7692-4352-87e9-0155c2125e90+5:18988:x1875469292167424:12345-192.168.203.14@tcp:900:lfs.0 00000100:00100000:1.0:1788587461.007169:0:21967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ddd9e77-7692-4352-87e9-0155c2125e90+5:18988:x1875469292167424:12345-192.168.203.14@tcp:900:lfs.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.007177:0:21967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00080000:2.0:1788587461.007341:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788587461.017537:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587461.017595:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.017686:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292167680 00000100:00100000:1.0:1788587461.017697:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292167680 00000100:00100000:1.0:1788587461.017757:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:1.0:1788587461.017767:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+7:18988:x1875469292167680:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:1.0:1788587461.017787:0:21955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587461.017839:0:21955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cdc00/0x419e1ae1f63457f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e65 expref: -99 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587461.017934:0:21955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788587461.018059:0:21955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cdc00/0x419e1ae1f63457f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e65 expref: 9 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.018075:0:21955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c72200) 00010000:00010000:1.0:1788587461.018078:0:21955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587461.018083:0:21955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cdc00/0x419e1ae1f63457f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e65 expref: 9 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.018097:0:21955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cdc00, rc 0) 00000100:00100000:1.0:1788587461.018146:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+8:18988:x1875469292167680:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 381us (620us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1788587461.018153:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 32 00000100:00100000:0.0:1788587461.018478:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292167808 00000100:00100000:0.0:1788587461.018497:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292167808 00000100:00100000:0.0:1788587461.018537:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 146 00000100:00100000:0.0:1788587461.018545:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+11:18355:x1875469292167808:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587461.018554:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587461.018566:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499ea00/0x419e1ae1f6345805 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e6c expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.018586:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499ea00/0x419e1ae1f6345805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e6c expref: 12 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.018596:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499ea00/0x419e1ae1f6345805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e6c expref: 12 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.018604:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499ea00, rc 0) 00000100:00100000:0.0:1788587461.018638:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+12:18355:x1875469292167808:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 94us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587461.018645:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 146 00000100:00100000:2.0:1788587461.030621:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.030719:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292167936 00000100:00100000:1.0:1788587461.030730:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292167936 00000100:00100000:1.0:1788587461.030788:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 147 00000100:00100000:1.0:1788587461.030831:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+12:18355:x1875469292167936:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587461.031105:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+12:18355:x1875469292167936:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 308us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.031121:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 147 00000100:00100000:2.0:1788587461.032010:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587461.032695:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292168192 00000100:00100000:3.0:1788587461.032704:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292168192 00000100:00100000:3.0:1788587461.032757:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:3.0:1788587461.032766:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddd9e77-7692-4352-87e9-0155c2125e90+8:18988:x1875469292168192:12345-192.168.203.14@tcp:36:lfs.0 00010000:00010000:3.0:1788587461.032855:0:23996:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587461.032881:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63457f0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e5e expref: 8 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.032916:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:3.0:1788587461.032922:0:23996:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587461.032944:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.032957:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.032966:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587461.033150:0:23996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e3baf87 reply state 00000000064afd25 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.033162:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.033168:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:3.0:1788587461.033171:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788587461.033173:0:23996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788587461.033181:0:23996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788587461.033254:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddd9e77-7692-4352-87e9-0155c2125e90+9:18988:x1875469292168192:12345-192.168.203.14@tcp:36:lfs.0 Request processed in 488us (1248us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788587461.033271:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 33 00000100:00100000:2.0:1788587461.043224:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587461.043677:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.043857:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292168320 00000100:00100000:1.0:1788587461.043866:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292168320 00000100:00100000:1.0:1788587461.043917:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 148 00000100:00100000:1.0:1788587461.043927:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+12:18355:x1875469292168320:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587461.044133:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+12:18355:x1875469292168320:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 207us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.044141:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 148 00000100:00100000:3.0:1788587461.044389:0:21958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292168576 00000100:00100000:3.0:1788587461.044394:0:21958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292168576 00000100:00100000:3.0:1788587461.044427:0:21958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:3.0:1788587461.044434:0:21958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+9:18988:x1875469292168576:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:3.0:1788587461.044615:0:21958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+10:18988:x1875469292168576:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 181us (938us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788587461.044630:0:21958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:2.0:1788587461.056290:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587461.056349:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587461.056578:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292168832 00000100:00100000:3.0:1788587461.056589:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292168832 00000100:00100000:3.0:1788587461.056648:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:3.0:1788587461.056658:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+10:18988:x1875469292168832:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:3.0:1788587461.056679:0:21957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587461.056697:0:21957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f6345813 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e73 expref: -99 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.056773:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f634581a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.056789:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f634581a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.056840:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f634581a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.056852:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27800/0x419e1ae1f6345821 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.056860:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27800/0x419e1ae1f6345821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.056867:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27800/0x419e1ae1f6345821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587461.056939:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292168960 00000100:00100000:0.0:1788587461.056944:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292168960 00000100:00100000:0.0:1788587461.056976:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 149 00000004:00200000:3.0:1788587461.056978:0:21957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788587461.056982:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+12:18355:x1875469292168960:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587461.056989:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587461.056999:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f634582f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e7a expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.057015:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f634582f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e7a expref: 13 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.057041:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499e800/0x419e1ae1f634582f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e7a expref: 13 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.057049:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e800, rc 0) 00010000:00010000:3.0:1788587461.057066:0:21957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f634581a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.057082:0:21957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f634581a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.057088:0:21957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f634581a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.057093:0:21957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587461.057098:0:21957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f634581a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587461.057100:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18355:x1875469292168960:12345-192.168.203.14@tcp:101:ll_cfg_requeue.0 Request processed in 118us (751us total) trans 0 rc 0/0 00010000:00010000:3.0:1788587461.057107:0:21957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f634581a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587461.057107:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 149 00010000:00010000:3.0:1788587461.057119:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c72200) 00010000:00010000:3.0:1788587461.057121:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587461.057126:0:21957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f634581a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.057132:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f634581a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.057151:0:21957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27800/0x419e1ae1f6345821 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.057157:0:21957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27800/0x419e1ae1f6345821 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.057163:0:21957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27800/0x419e1ae1f6345821 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.057168:0:21957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27800 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587461.057176:0:21957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27800/0x419e1ae1f6345821 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.057182:0:21957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27800/0x419e1ae1f6345821 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.057190:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cbf02c76700) 00010000:00010000:3.0:1788587461.057192:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587461.057195:0:21957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27800/0x419e1ae1f6345821 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.057201:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27800/0x419e1ae1f6345821 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.057324:0:21957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f6345813 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e73 expref: 12 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.057335:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c72200) 00010000:00010000:0.0:1788587461.057337:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587461.057340:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f6345813 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e73 expref: 12 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.057355:0:21957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26800, rc 0) 00000100:00100000:0.0:1788587461.057388:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ddd9e77-7692-4352-87e9-0155c2125e90+11:18988:x1875469292168832:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 732us (1109us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788587461.057394:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 34 00000100:00100000:2.0:1788587461.062977:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587461.063066:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587461.063129:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292169088 00000100:00100000:3.0:1788587461.063139:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292169088 00000100:00100000:3.0:1788587461.063232:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:3.0:1788587461.063243:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddd9e77-7692-4352-87e9-0155c2125e90+11:18988:x1875469292169088:12345-192.168.203.14@tcp:101:lfs.0 00000100:00100000:1.0:1788587461.063243:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292169216 00000100:00100000:1.0:1788587461.063246:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292169216 00010000:00010000:3.0:1788587461.063275:0:23996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788587461.063287:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 150 00000100:00100000:1.0:1788587461.063293:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18355:x1875469292169216:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 00010000:00010000:3.0:1788587461.063295:0:23996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6345836 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e81 expref: -99 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.063382:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.063396:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.063407:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587461.063440:0:23996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587461.063444:0:23996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:3.0:1788587461.063463:0:23996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.063486:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26600/0x419e1ae1f6345836 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e81 expref: 13 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.063504:0:23996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e81 expref: 12 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.063513:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:3.0:1788587461.063515:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587461.063518:0:23996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f26800, rc 0) 00000100:00100000:1.0:1788587461.063637:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18355:x1875469292169216:12345-192.168.203.14@tcp:501:ll_cfg_requeue.0 Request processed in 342us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.063645:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 150 00000100:00100000:0.0:1788587461.064463:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ddd9e77-7692-4352-87e9-0155c2125e90+12:18988:x1875469292169088:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 1217us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587461.064481:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 35 00000100:00100000:2.0:1788587461.066389:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587461.066533:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292169344 00000100:00100000:3.0:1788587461.066542:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292169344 00000100:00100000:3.0:1788587461.066960:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 151 00000100:00100000:3.0:1788587461.066969:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18355:x1875469292169344:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587461.067179:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:18355:x1875469292169344:12345-192.168.203.14@tcp:503:ll_cfg_requeue.0 Request processed in 211us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587461.067188:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 151 00000100:00100000:2.0:1788587461.068070:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587461.068153:0:21958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292169472 00000100:00100000:3.0:1788587461.068159:0:21958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292169472 00000100:00100000:3.0:1788587461.068244:0:21958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:3.0:1788587461.068254:0:21958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+12:18988:x1875469292169472:12345-192.168.203.14@tcp:37:lfs.0 00000100:00100000:0.0:1788587461.083365:0:21958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+12:18988:x1875469292169472:12345-192.168.203.14@tcp:37:lfs.0 Request processed in 15100us (15286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587461.083379:0:21958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:2.0:1788587461.092902:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.092997:0:21959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292169728 00000100:00100000:1.0:1788587461.093007:0:21959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292169728 00000100:00100000:1.0:1788587461.093068:0:21959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:1.0:1788587461.093151:0:21959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf04961850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+12:18988:x1875469292169728:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788587461.093397:0:21959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf04961850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+13:18988:x1875469292169728:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 320us (505us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788587461.093405:0:21959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000040:00080000:2.0:1788587461.164552:0:21990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788587461.164958:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310101120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587461.165024:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587461.165149:0:23269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310101120 00000100:00100000:1.0:1788587461.165157:0:23269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310101120 00000100:00100000:1.0:1788587461.165229:0:23269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587461.165238:0:23269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310101120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587461.165284:0:23269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788587461.165345:0:23269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310101120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.165352:0:23269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788587461.165397:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310101120:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788587461.165693:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587461.170288:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587461.170404:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292169856 00000100:00100000:0.0:1788587461.170415:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292169856 00000100:00100000:0.0:1788587461.170485:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:0.0:1788587461.170495:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+11:18996:x1875469292169856:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587461.170515:0:21957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587461.170535:0:21957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6345844 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e88 expref: -99 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170598:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634584b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170614:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634584b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170626:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634584b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170639:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6345852 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170647:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6345852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170654:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6345852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170748:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345859 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170772:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345859 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170780:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345859 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587461.170837:0:21957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587461.170841:0:21957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587461.170881:0:21957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345859 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170893:0:21957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634584b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170899:0:21957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634584b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170906:0:21957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634584b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170912:0:21957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587461.170916:0:21957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634584b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170924:0:21957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634584b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170935:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c72200) 00010000:00010000:0.0:1788587461.170938:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587461.170943:0:21957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634584b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170961:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e400/0x419e1ae1f634584b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170976:0:21957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6345852 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170982:0:21957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6345852 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170988:0:21957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6345852 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.170993:0:21957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ec00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587461.170996:0:21957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6345852 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.171002:0:21957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6345852 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.171010:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cbf02c76700) 00010000:00010000:0.0:1788587461.171013:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587461.171016:0:21957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6345852 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.171022:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f6345852 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.171048:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6345844 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e88 expref: 13 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.171074:0:21957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e600/0x419e1ae1f6345859 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e88 expref: 12 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.171081:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:0.0:1788587461.171084:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788587461.171087:0:21957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e600, rc 0) 00000100:00100000:0.0:1788587461.171150:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+12:18996:x1875469292169856:12345-192.168.203.14@tcp:101:bash.0 Request processed in 657us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587461.171158:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 36 00000100:00100000:2.0:1788587461.174637:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.174775:0:21967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292169984 00000100:00100000:1.0:1788587461.174785:0:21967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292169984 00000100:00100000:1.0:1788587461.174868:0:21967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:1.0:1788587461.174878:0:21967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:18996:x1875469292169984:12345-192.168.203.14@tcp:900:bash.0 00000100:00100000:1.0:1788587461.174955:0:21967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:18996:x1875469292169984:12345-192.168.203.14@tcp:900:bash.0 Request processed in 77us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.174963:0:21967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788587461.176938:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.177053:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292170240 00000100:00100000:1.0:1788587461.177063:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292170240 00000100:00100000:1.0:1788587461.177114:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:1.0:1788587461.177125:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+12:18996:x1875469292170240:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:1.0:1788587461.177154:0:21956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587461.177174:0:21956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cdc00/0x419e1ae1f6345860 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e8f expref: -99 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.177303:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.177331:0:21956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e81 expref: 12 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.177358:0:21956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.177393:0:21956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e81 expref: 12 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.177406:0:21956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e81 expref: 12 pid: 23996 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587461.177420:0:21956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:21956:1875469310101248:192.168.203.14@tcp:104: 00000100:00100000:1.0:1788587461.177512:0:21956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf06327300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587461.183953:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587461.184036:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292170368 00000100:00100000:0.0:1788587461.184045:0:21941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292170368 00010000:00010000:0.0:1788587461.184085:0:21941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e81 expref: 13 pid: 23996 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587461.184128:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:0.0:1788587461.184139:0:21941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+13:2409:x1875469292170368:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587461.184153:0:21941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587461.184160:0:21941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e81 expref: 13 pid: 23996 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.184173:0:21941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e81 expref: 13 pid: 23996 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.184194:0:21941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:0.0:1788587461.184200:0:21941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.184223:0:21941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.184232:0:21941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.184253:0:21941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587461.184328:0:21941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+13:2409:x1875469292170368:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 190us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587461.184337:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00010000:00010000:1.0:1788587461.184378:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26800/0x419e1ae1f634583d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e81 expref: 12 pid: 23996 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587461.184402:0:21956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:21956:1875469310101248:192.168.203.14@tcp:104: 00010000:00010000:1.0:1788587461.184424:0:21956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.184434:0:21956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.184440:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.184582:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.184593:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.184610:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187009:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345875 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187029:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345875 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187041:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345875 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587461.187052:0:21956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788587461.187325:0:21956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187334:0:21956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187340:0:21956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187346:0:21956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587461.187350:0:21956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187357:0:21956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187370:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:1.0:1788587461.187374:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587461.187389:0:21956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187396:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc400/0x419e1ae1f6345867 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587461.187410:0:21956:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecdf1356 reply state 000000000a1742ab transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187420:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187427:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8cbf02c72400) 00010000:00010000:1.0:1788587461.187429:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788587461.187432:0:21956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788587461.187910:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cdc00/0x419e1ae1f6345860 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e8f expref: 15 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187931:0:21956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345875 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e8f expref: 14 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.187939:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:1.0:1788587461.187941:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788587461.187944:0:21956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cce00, rc 0) 00000100:00100000:1.0:1788587461.188021:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+15:18996:x1875469292170240:12345-192.168.203.14@tcp:101:bash.0 Request processed in 10896us (11090us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788587461.188030:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 37 00000100:00100000:2.0:1788587461.206948:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587461.208551:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292170496 00000100:00100000:0.0:1788587461.208575:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292170496 00000100:00100000:0.0:1788587461.208654:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:0.0:1788587461.208668:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+15:18996:x1875469292170496:12345-192.168.203.14@tcp:101:bash.0 00010000:00010000:0.0:1788587461.208696:0:21957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587461.208720:0:21957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6345883 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e96 expref: -99 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.208790:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.208848:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.208859:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587461.208898:0:21957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788587461.208902:0:21957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587461.208936:0:21957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.208947:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.208974:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f600/0x419e1ae1f6345883 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e96 expref: 17 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.208994:0:21957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e96 expref: 16 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.209003:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:0.0:1788587461.209006:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587461.209009:0:21957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499ec00, rc 0) 00000100:00100000:0.0:1788587461.209081:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+16:18996:x1875469292170496:12345-192.168.203.14@tcp:101:bash.0 Request processed in 416us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587461.209090:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 38 00000100:00100000:3.0:1788587461.211822:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.211885:0:21959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292170752 00000100:00100000:1.0:1788587461.211895:0:21959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292170752 00000100:00100000:1.0:1788587461.211954:0:21959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:1.0:1788587461.211964:0:21959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+16:18996:x1875469292170752:12345-192.168.203.14@tcp:35:bash.0 00000100:00100000:1.0:1788587461.212326:0:21959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+17:18996:x1875469292170752:12345-192.168.203.14@tcp:35:bash.0 Request processed in 362us (536us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788587461.212333:0:21959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000040:00080000:1.0:1788587461.227781:0:22612:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788587461.227958:0:21952:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587461.227963:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf04665800 from 13 10000000:01000000:0.0:1788587461.227967:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587461.228009:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6345891 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.228021:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6345891 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.228032:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6345891 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587461.228056:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310101376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587461.228147:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587461.228190:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0678c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587461.228369:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310101376 00000100:00100000:1.0:1788587461.228377:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310101376 00000100:00100000:1.0:1788587461.228692:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788587461.228704:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+20:21952:x1875469310101376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587461.228786:0:21947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587461.228822:0:21947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f6345898 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f6345891 expref: -99 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.228849:0:21947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f6345898 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f6345891 expref: 21 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.228860:0:21947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf421cdc00/0x419e1ae1f6345898 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f6345891 expref: 21 pid: 21947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.228869:0:21947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cdc00, rc 0) 00000100:00100000:1.0:1788587461.229019:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:21952:x1875469310101376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 317us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.229025:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788587461.229130:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310101376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587461.229213:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6345891 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345898 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.229224:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6345891 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f6345898 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587461.233199:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310101504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587461.234029:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587461.234090:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587461.234319:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310101504 00000100:00100000:3.0:1788587461.234328:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310101504 00000100:00100000:3.0:1788587461.234384:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788587461.234393:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:21952:x1875469310101504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587461.234673:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:21952:x1875469310101504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587461.234681:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788587461.234900:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310101504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587461.234948:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310101632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587461.234990:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587461.235021:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587461.235068:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310101632 00000100:00100000:1.0:1788587461.235073:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310101632 00000100:00100000:1.0:1788587461.235106:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788587461.235113:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:21952:x1875469310101632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587461.235285:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:21952:x1875469310101632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.235299:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788587461.235486:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310101632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788587461.236467:0:24724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788587461.236739:0:21952:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788587461.236759:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587461.236770:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6345891 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345898 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.236781:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf0499f600/0x419e1ae1f6345891 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f6345898 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587461.236819:0:21952:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587461.236823:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf195f9800 from 13 10000000:01000000:2.0:1788587461.236826:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587461.236858:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044600/0x419e1ae1f634589f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.236866:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf42044600/0x419e1ae1f634589f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.236876:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf42044600/0x419e1ae1f634589f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587461.236895:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310101760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587461.236947:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587461.236987:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01254b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587461.237230:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310101760 00000100:00100000:3.0:1788587461.237237:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310101760 00000100:00100000:3.0:1788587461.237294:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788587461.237303:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+21:21952:x1875469310101760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587461.237313:0:21949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587461.237326:0:21949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f63458a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f634589f expref: -99 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.237347:0:21949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f63458a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f634589f expref: 22 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.237358:0:21949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe05f27800/0x419e1ae1f63458a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f634589f expref: 22 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587461.237367:0:21949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe05f27800, rc 0) 00000100:00100000:3.0:1788587461.237412:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:21952:x1875469310101760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587461.237418:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788587461.237603:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310101760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587461.237618:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf42044600/0x419e1ae1f634589f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63458a6 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.237626:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf42044600/0x419e1ae1f634589f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63458a6 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587461.237676:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310101888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587461.237703:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587461.237733:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf01254b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587461.237833:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310101888 00000100:00100000:1.0:1788587461.237838:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310101888 00000100:00100000:1.0:1788587461.237863:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788587461.237870:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:21952:x1875469310101888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587461.239386:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:21952:x1875469310101888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1510us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.239397:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788587461.239612:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310101888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587461.239663:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587461.239708:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587461.239744:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0678ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587461.239855:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310102016 00000100:00100000:1.0:1788587461.239862:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310102016 00000100:00100000:1.0:1788587461.239891:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788587461.239898:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:21952:x1875469310102016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587461.240036:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:21952:x1875469310102016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.240043:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788587461.240122:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788587461.246240:0:24725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788587461.246669:0:21952:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788587461.246693:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587461.246704:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf42044600/0x419e1ae1f634589f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63458a6 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.246715:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf42044600/0x419e1ae1f634589f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63458a6 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587461.246726:0:21952:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587461.246728:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf02a84800 from 13 10000000:01000000:1.0:1788587461.246731:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587461.246776:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc400/0x419e1ae1f63458ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.246784:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc400/0x419e1ae1f63458ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.246820:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc400/0x419e1ae1f63458ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587461.246846:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587461.246914:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587461.246954:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf052323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587461.247057:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310102144 00000100:00100000:0.0:1788587461.247065:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310102144 00000100:00100000:0.0:1788587461.247115:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788587461.247124:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+22:21952:x1875469310102144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587461.247223:0:21948:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587461.247237:0:21948:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf0499e400/0x419e1ae1f63458b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63458ad expref: -99 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.247268:0:21948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf0499e400/0x419e1ae1f63458b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63458ad expref: 23 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.247279:0:21948:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf0499e400/0x419e1ae1f63458b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63458ad expref: 23 pid: 21948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.247288:0:21948:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499e400, rc 0) 00000100:00100000:0.0:1788587461.247413:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:21952:x1875469310102144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 289us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587461.247420:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788587461.247503:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587461.247516:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc400/0x419e1ae1f63458ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63458b4 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.247525:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc400/0x419e1ae1f63458ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63458b4 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587461.247573:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587461.247598:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587461.247618:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf052323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587461.247718:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310102272 00000100:00100000:3.0:1788587461.247723:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310102272 00000100:00100000:3.0:1788587461.247752:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788587461.247759:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:21952:x1875469310102272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587461.248014:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:21952:x1875469310102272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587461.248022:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788587461.248099:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587461.248130:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587461.248246:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587461.248374:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1873db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587461.255331:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310102400 00000100:00100000:3.0:1788587461.255346:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310102400 00000100:00100000:3.0:1788587461.255405:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788587461.255414:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf342b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:21952:x1875469310102400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587461.256066:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf342b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:21952:x1875469310102400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 651us (7818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587461.256067:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587461.256075:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000040:00080000:3.0:1788587461.257502:0:24726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788587461.257765:0:21952:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788587461.257786:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587461.257819:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc400/0x419e1ae1f63458ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63458b4 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.257831:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf421cc400/0x419e1ae1f63458ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63458b4 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587461.257841:0:21952:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587461.257843:0:21952:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbf3b397800 from 13 10000000:01000000:0.0:1788587461.257846:0:21952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587461.257881:0:21952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fc00/0x419e1ae1f63458bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.257889:0:21952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fc00/0x419e1ae1f63458bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.257994:0:21952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fc00/0x419e1ae1f63458bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587461.258019:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587461.258072:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587461.258376:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310102528 00000100:00100000:2.0:1788587461.258383:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310102528 00000100:00100000:2.0:1788587461.258466:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788587461.258476:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3438d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+23:21952:x1875469310102528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587461.258488:0:21949:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587461.258501:0:21949:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbf42044c00/0x419e1ae1f63458c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x419e1ae1f63458bb expref: -99 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.258524:0:21949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbf42044c00/0x419e1ae1f63458c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x419e1ae1f63458bb expref: 24 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.258535:0:21949:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbf42044c00/0x419e1ae1f63458c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x419e1ae1f63458bb expref: 24 pid: 21949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.258544:0:21949:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf42044c00, rc 0) 00000100:00100000:2.0:1788587461.258593:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3438d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:21952:x1875469310102528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587461.258600:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788587461.258629:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf081caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587461.258652:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587461.258665:0:21952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fc00/0x419e1ae1f63458bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63458c2 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.258673:0:21952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fc00/0x419e1ae1f63458bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x419e1ae1f63458c2 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587461.258719:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587461.258745:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587461.258765:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf081caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587461.258993:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310102656 00000100:00100000:3.0:1788587461.258999:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310102656 00000100:00100000:3.0:1788587461.259020:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788587461.259027:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3438e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:21952:x1875469310102656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587461.259875:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3438e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:21952:x1875469310102656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 847us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587461.259883:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788587461.260063:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587461.260104:0:21952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587461.260146:0:21952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587461.260170:0:21948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310102784 00000100:00100000:3.0:1788587461.260176:0:21948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310102784 00000100:00100000:2.0:1788587461.260179:0:21952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf083bdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587461.260198:0:21948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788587461.260205:0:21948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3438dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:21952:x1875469310102784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587461.260889:0:21948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3438dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:21952:x1875469310102784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 682us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587461.260966:0:21948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788587461.261685:0:21952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:21952:1875469310102784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788587461.263100:0:24727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788587461.263280:0:21952:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788587461.263307:0:21952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587461.263319:0:21952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fc00/0x419e1ae1f63458bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63458c2 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.263330:0:21952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.114@tcp lock: ffff8cbf0499fc00/0x419e1ae1f63458bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x419e1ae1f63458c2 expref: -99 pid: 21952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587461.298959:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587461.299324:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292171008 00000100:00100000:0.0:1788587461.299335:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292171008 00000100:00100000:0.0:1788587461.299397:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:0.0:1788587461.299408:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+17:19006:x1875469292171008:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587461.299431:0:23996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587461.299450:0:23996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f63458c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5e9d expref: -99 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587461.299537:0:23996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788587461.299753:0:23996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f63458c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e9d expref: 19 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.299780:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbf02c72200) 00010000:00010000:0.0:1788587461.299783:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587461.299788:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f63458c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e9d expref: 19 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.299834:0:23996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f400, rc 0) 00000100:00100000:0.0:1788587461.299896:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+18:19006:x1875469292171008:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 489us (947us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788587461.299904:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 39 00000100:00100000:2.0:1788587461.304644:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.304715:0:21959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292171264 00000100:00100000:1.0:1788587461.304734:0:21959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292171264 00000100:00100000:1.0:1788587461.304831:0:21959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:1.0:1788587461.304842:0:21959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+18:19006:x1875469292171264:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788587461.305062:0:21959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+19:19006:x1875469292171264:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 220us (424us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788587461.305085:0:21959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:3.0:1788587461.356341:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587461.356520:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292171520 00000100:00100000:0.0:1788587461.356532:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292171520 00000100:00100000:0.0:1788587461.356599:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:0.0:1788587461.356610:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+19:19009:x1875469292171520:12345-192.168.203.14@tcp:101:lfs.0 00010000:00010000:0.0:1788587461.356631:0:21957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587461.356652:0:21957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f63458d7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ea4 expref: -99 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.356743:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63458de lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.356756:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63458de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.356768:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63458de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587461.356779:0:21957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788587461.356954:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f63458d7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ea4 expref: 22 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.356977:0:21957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63458de lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ea4 expref: 21 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.356985:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:0.0:1788587461.356988:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587461.356991:0:21957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fa00, rc 0) 00000100:00100000:0.0:1788587461.357052:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+21:19009:x1875469292171520:12345-192.168.203.14@tcp:101:lfs.0 Request processed in 443us (729us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788587461.357293:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 40 00000100:00100000:3.0:1788587461.359672:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587461.359760:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587461.360698:0:21940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292171648 00000100:00100000:0.0:1788587461.360712:0:21940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292171648 00000100:00100000:0.0:1788587461.360774:0:21940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:0.0:1788587461.360785:0:21940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+21:2409:x1875469292171648:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587461.360816:0:21940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587461.360843:0:21940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f63458de lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ea4 expref: 21 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.360863:0:21940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:0.0:1788587461.360879:0:21940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587461.360939:0:21940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+20:2409:x1875469292171648:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 155us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587461.360947:0:21940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:1.0:1788587461.362295:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292171776 00000100:00100000:1.0:1788587461.362306:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292171776 00000100:00100000:1.0:1788587461.362766:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:1.0:1788587461.362778:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+20:19009:x1875469292171776:12345-192.168.203.14@tcp:54:lfs.0 00010000:00010000:1.0:1788587461.362864:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458ec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.362901:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.362915:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.362941:0:21956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.362948:0:21956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458ec lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.362955:0:21956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458ec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.362960:0:21956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cd000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587461.362965:0:21956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458ec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.362972:0:21956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458ec lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.362985:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:1.0:1788587461.363004:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587461.363010:0:21956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458ec lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.363016:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458ec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587461.363096:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+20:19009:x1875469292171776:12345-192.168.203.14@tcp:54:lfs.0 Request processed in 320us (3432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.363104:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 41 00000100:00100000:3.0:1788587461.364968:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.366186:0:21959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292172032 00000100:00100000:1.0:1788587461.366198:0:21959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292172032 00000100:00100000:1.0:1788587461.366417:0:21959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:1.0:1788587461.366429:0:21959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+20:19009:x1875469292172032:12345-192.168.203.14@tcp:35:lfs.0 00000100:00100000:1.0:1788587461.366670:0:21959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+21:19009:x1875469292172032:12345-192.168.203.14@tcp:35:lfs.0 Request processed in 243us (1710us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788587461.366678:0:21959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788587461.596331:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.596453:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292172288 00000100:00100000:1.0:1788587461.596464:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292172288 00000100:00100000:1.0:1788587461.596654:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:1.0:1788587461.596665:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+21:19040:x1875469292172288:12345-192.168.203.14@tcp:101:cat.0 00010000:00010000:1.0:1788587461.596689:0:21955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587461.596709:0:21955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458f3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5eab expref: -99 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.596843:0:21955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63458fa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.596858:0:21955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63458fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.596883:0:21955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63458fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587461.596896:0:21955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788587461.597030:0:21955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f63458f3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eab expref: 24 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.597054:0:21955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63458fa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eab expref: 23 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.597063:0:21955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:1.0:1788587461.597065:0:21955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587461.597069:0:21955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cc200, rc 0) 00000100:00100000:1.0:1788587461.597163:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+23:19040:x1875469292172288:12345-192.168.203.14@tcp:101:cat.0 Request processed in 500us (838us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788587461.597169:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 42 00000100:00100000:3.0:1788587461.600338:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587461.600432:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587461.600571:0:21958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292172544 00000100:00100000:0.0:1788587461.600581:0:21958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292172544 00000100:00100000:0.0:1788587461.600649:0:21958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:0.0:1788587461.600659:0:21958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+23:19040:x1875469292172544:12345-192.168.203.14@tcp:35:cat.0 00000100:00100000:2.0:1788587461.600933:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292172672 00000100:00100000:2.0:1788587461.600938:0:21942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292172672 00000100:00100000:0.0:1788587461.601015:0:21958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+25:19040:x1875469292172544:12345-192.168.203.14@tcp:35:cat.0 Request processed in 357us (582us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1788587461.601023:0:21958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 8 00000100:00100000:2.0:1788587461.601030:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:2.0:1788587461.601037:0:21942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+24:2411:x1875469292172672:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587461.601046:0:21942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587461.601067:0:21942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f63458fa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eab expref: 24 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.601084:0:21942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:2.0:1788587461.601089:0:21942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587461.601109:0:21942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+23:2411:x1875469292172672:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 74us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587461.601116:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:3.0:1788587461.656032:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587461.656132:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292172928 00000100:00100000:0.0:1788587461.656151:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292172928 00000100:00100000:0.0:1788587461.656209:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:0.0:1788587461.656219:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+23:19046:x1875469292172928:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:0.0:1788587461.656243:0:23996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587461.656269:0:23996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345908 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5eb2 expref: -99 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.656364:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f634590f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.656377:0:23996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345875 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e8f expref: 24 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.656386:0:23996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e96 expref: 24 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.656394:0:23996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f634590f lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.656428:0:23996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e96 expref: 24 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.656460:0:23996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e96 expref: 24 pid: 21957 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587461.656483:0:23996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23996:1875469310102912:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587461.656571:0:23996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345875 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e8f expref: 24 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.656581:0:23996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345875 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e8f expref: 24 pid: 21956 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587461.656589:0:23996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23996:1875469310103040:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587461.656612:0:23996:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf081ca3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587461.659857:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587461.659895:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587461.659925:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292173184 00000100:00100000:2.0:1788587461.659935:0:21941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292173184 00010000:00010000:2.0:1788587461.659973:0:21941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345875 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e8f expref: 25 pid: 21956 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587461.660028:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292173056 00000100:00100000:2.0:1788587461.660032:0:21941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292173056 00010000:00010000:2.0:1788587461.660047:0:21941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e96 expref: 26 pid: 21957 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587461.660062:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:2.0:1788587461.660071:0:21941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+26:2409:x1875469292173184:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587461.660085:0:21941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587461.660091:0:21941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345875 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e8f expref: 26 pid: 21956 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.660101:0:21941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345875 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e8f expref: 26 pid: 21956 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.660121:0:21941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:2.0:1788587461.660127:0:21941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f634590f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.660136:0:21941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f634590f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.660142:0:21941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587461.660195:0:21941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+26:2409:x1875469292173184:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 125us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587461.660203:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:2.0:1788587461.660233:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 18 00000100:00100000:2.0:1788587461.660240:0:21941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf33bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+25:2409:x1875469292173056:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587461.660265:0:21941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587461.660270:0:21941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e96 expref: 25 pid: 21957 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.660280:0:21941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e96 expref: 25 pid: 21957 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.660291:0:21941:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:2.0:1788587461.660294:0:21941:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f634590f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.660302:0:21941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f634590f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.660310:0:21941:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f634590f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.660326:0:21941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587461.660347:0:21941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf33bbec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+25:2409:x1875469292173056:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 108us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587461.660354:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 18 00010000:00010000:0.0:1788587461.662102:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634588a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e96 expref: 24 pid: 21957 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587461.662125:0:23996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23996:1875469310102912:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587461.662199:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f6345875 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5e8f expref: 23 pid: 21956 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587461.662213:0:23996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23996:1875469310103040:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587461.662238:0:23996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f634590f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.662246:0:23996:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f634590f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.662275:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f634590f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587461.662297:0:23996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788587461.662462:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345908 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eb2 expref: 24 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.664188:0:23996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499f400/0x419e1ae1f634590f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eb2 expref: 23 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.664199:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:0.0:1788587461.664202:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587461.664206:0:23996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499f400, rc 0) 00000100:00100000:0.0:1788587461.664389:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+23:19046:x1875469292172928:12345-192.168.203.14@tcp:101:dd.0 Request processed in 8170us (8364us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788587461.664398:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 43 00000100:00100000:3.0:1788587461.667959:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587461.668431:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292173440 00000100:00100000:0.0:1788587461.668444:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292173440 00000100:00100000:0.0:1788587461.668616:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 44 00000100:00100000:0.0:1788587461.668627:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+23:19046:x1875469292173440:12345-192.168.203.14@tcp:36:dd.0 00010000:00010000:0.0:1788587461.668927:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.668954:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.668966:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587461.669032:0:21957:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788587461.669068:0:21957:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fad834c reply state 00000000cd0d0d51 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.669080:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.669086:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:0.0:1788587461.669089:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587461.669092:0:21957:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587461.669187:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+26:19046:x1875469292173440:12345-192.168.203.14@tcp:36:dd.0 Request processed in 562us (1468us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788587461.669194:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 44 00000020:00080000:0.0:1788587461.669198:0:21957:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788587461.672579:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.672710:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292173568 00000100:00100000:1.0:1788587461.672720:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292173568 00000100:00100000:1.0:1788587461.672775:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:1.0:1788587461.672784:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+26:19046:x1875469292173568:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:1.0:1788587461.672841:0:21956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587461.672860:0:21956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345924 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5eb9 expref: -99 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.672919:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345924 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eb9 expref: 27 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.673202:0:21956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345924 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eb9 expref: 27 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.673225:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:1.0:1788587461.673228:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587461.673232:0:21956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cd000, rc 0) 00000100:00100000:1.0:1788587461.673303:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+27:19046:x1875469292173568:12345-192.168.203.14@tcp:101:dd.0 Request processed in 519us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.673311:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 45 00000100:00100000:3.0:1788587461.705938:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587461.706073:0:21942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292173824 00000100:00100000:2.0:1788587461.706084:0:21942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292173824 00000100:00100000:2.0:1788587461.706164:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:2.0:1788587461.706174:0:21942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+27:19046:x1875469292173824:12345-192.168.203.14@tcp:103:dd.0 00010000:00010000:2.0:1788587461.706189:0:21942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587461.706213:0:21942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f6345924 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eb9 expref: 27 pid: 21956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587461.706264:0:21942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:2.0:1788587461.706270:0:21942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587461.706324:0:21942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+26:19046:x1875469292173824:12345-192.168.203.14@tcp:103:dd.0 Request processed in 152us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587461.706332:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:3.0:1788587461.709911:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587461.710000:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292173952 00000100:00100000:1.0:1788587461.710010:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292173952 00000100:00100000:1.0:1788587461.710077:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:1.0:1788587461.710087:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+26:19046:x1875469292173952:12345-192.168.203.14@tcp:58:dd.0 00010000:00010000:1.0:1788587461.710191:0:21955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.710209:0:21955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587461.710221:0:21955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587461.720339:0:21955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587461.720526:0:21955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788587461.720610:0:21955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788587461.720742:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+26:19046:x1875469292173952:12345-192.168.203.14@tcp:58:dd.0 Request processed in 10651us (10836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587461.720769:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 46 00000100:00100000:3.0:1788587461.728998:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587461.729106:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292174080 00000100:00100000:0.0:1788587461.729116:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292174080 00000100:00100000:0.0:1788587461.729187:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 47 00000100:00100000:0.0:1788587461.729197:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+26:19046:x1875469292174080:12345-192.168.203.14@tcp:101:dd.0 00010000:00010000:0.0:1788587461.729216:0:23996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587461.729237:0:23996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345932 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ec0 expref: -99 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.729301:0:23996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.729312:0:23996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345932 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ec0 expref: 27 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.729347:0:23996:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.729361:0:23996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345932 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ec0 expref: 27 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.729374:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:0.0:1788587461.729377:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587461.729381:0:23996:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345932 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ec0 expref: 27 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587461.729389:0:23996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf0499fa00, rc 0) 00000100:00100000:0.0:1788587461.729450:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+27:19046:x1875469292174080:12345-192.168.203.14@tcp:101:dd.0 Request processed in 254us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587461.729457:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 47 00010000:00010000:0.0:1788587461.870359:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587462.187367:0:21990:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788587462.187376:0:21990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587462.187672:0:21990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788587462.187683:0:21990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788587462.187956:0:21990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8bd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:21990:1875469310103168:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587462.188051:0:21990:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf081ca000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587462.196725:0:21990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8bd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:21990:1875469310103168:192.168.203.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788587462.200990:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587462.201676:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292174208 00000100:00100000:0.0:1788587462.201686:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292174208 00000100:00100000:0.0:1788587462.201916:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:0.0:1788587462.201941:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+27:19047:x1875469292174208:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788587462.201973:0:21957:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788587462.202096:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+27:19047:x1875469292174208:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 159us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587462.202103:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 48 00000100:00100000:3.0:1788587462.207567:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587462.207677:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292174336 00000100:00100000:0.0:1788587462.207686:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292174336 00000100:00100000:0.0:1788587462.207858:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:0.0:1788587462.207870:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+27:19047:x1875469292174336:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788587462.207949:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345939 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.207965:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345939 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.207978:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345939 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.207995:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f6345940 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.208002:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f6345940 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.208008:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f6345940 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.208030:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6345947 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.208646:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6345947 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.208662:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6345947 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587462.208701:0:23996:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788587462.209337:0:23996:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788587462.209359:0:23996:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6345947 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209372:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345939 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209378:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345939 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209384:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345939 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209390:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499e000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587462.209393:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345939 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209400:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345939 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209412:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf02c72100) 00010000:00010000:0.0:1788587462.209416:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587462.209421:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345939 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209440:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499e000/0x419e1ae1f6345939 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209456:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f6345940 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788587462.209559:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788587462.209606:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f6345940 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209615:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f6345940 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209620:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c18e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587462.209623:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f6345940 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209629:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f6345940 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209637:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8cbf2c8be000) 00010000:00010000:0.0:1788587462.209640:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587462.209643:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f6345940 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209649:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f6345940 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209666:0:23996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6345947 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209672:0:23996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6345947 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209684:0:23996:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6345947 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209689:0:23996:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587462.209692:0:23996:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6345947 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209699:0:23996:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6345947 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209946:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:0.0:1788587462.209950:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587462.209953:0:23996:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6345947 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.209959:0:23996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19a00/0x419e1ae1f6345947 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587462.210065:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+27:19047:x1875469292174336:12345-192.168.203.14@tcp:34:lhsmtool_posix.0 Request processed in 2186us (2496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587462.210081:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 49 00000100:00100000:3.0:1788587462.215977:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587462.216671:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292174592 00000100:00100000:0.0:1788587462.216682:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292174592 00000100:00100000:0.0:1788587462.216861:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:0.0:1788587462.216873:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+27:19047:x1875469292174592:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587462.216894:0:21957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587462.216914:0:21957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19600/0x419e1ae1f634594e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ec7 expref: -99 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217038:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345955 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217053:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345955 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217064:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345955 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587462.217073:0:21957:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788587462.217192:0:21957:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345955 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217201:0:21957:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345955 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217208:0:21957:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345955 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217213:0:21957:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19c00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:0.0:1788587462.217217:0:21957:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345955 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217224:0:21957:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345955 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217238:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:0.0:1788587462.217241:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587462.217246:0:21957:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345955 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217275:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f6345955 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217317:0:21957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19600/0x419e1ae1f634594e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ec7 expref: 29 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217327:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbf02c72100) 00010000:00010000:0.0:1788587462.217330:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587462.217333:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19600/0x419e1ae1f634594e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ec7 expref: 29 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.217343:0:21957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c19600, rc 0) 00000100:00100000:0.0:1788587462.217407:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+28:19047:x1875469292174592:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 536us (1440us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1788587462.217415:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 50 00000100:00100000:3.0:1788587462.221196:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.221409:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292174720 00000100:00100000:1.0:1788587462.221418:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292174720 00000100:00100000:1.0:1788587462.221491:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:1.0:1788587462.221502:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+28:19047:x1875469292174720:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788587462.221547:0:21956:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788587462.221671:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+28:19047:x1875469292174720:12345-192.168.203.14@tcp:53:lhsmtool_posix.0 Request processed in 169us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587462.221678:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 51 00000100:00100000:3.0:1788587462.225399:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.225842:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292174976 00000100:00100000:1.0:1788587462.225852:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292174976 00000100:00100000:1.0:1788587462.225906:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:1.0:1788587462.225917:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+28:19047:x1875469292174976:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587462.225934:0:21955:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587462.225954:0:21955:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345963 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ece expref: -99 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587462.228985:0:21955:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:1.0:1788587462.228997:0:21955:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788587462.229050:0:21955:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:1.0:1788587462.229625:0:21955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f634596a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.229642:0:21955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f634596a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.229654:0:21955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f634596a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.229741:0:21955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345963 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ece expref: 31 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.229759:0:21955:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f634596a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ece expref: 30 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.229768:0:21955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf02c72300) 00010000:00010000:1.0:1788587462.229771:0:21955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587462.229775:0:21955:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf421cd000, rc 0) 00000100:00100000:1.0:1788587462.229881:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+30:19047:x1875469292174976:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 3965us (4493us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1788587462.229889:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:3.0:1788587462.234369:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.237767:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292175232 00000100:00100000:1.0:1788587462.237783:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292175232 00000100:00100000:1.0:1788587462.238033:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:1.0:1788587462.238043:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+30:19047:x1875469292175232:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587462.238205:0:21956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587462.238229:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cd000/0x419e1ae1f634596a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ece expref: 30 pid: 21955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.238248:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf02c72300) 00010000:00010000:1.0:1788587462.239871:0:21956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587462.239903:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345978 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.239921:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345978 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.239947:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345978 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.239963:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634597f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd036438e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.239969:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634597f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd036438e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.239976:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634597f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd036438e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240040:0:21956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345978 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240048:0:21956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345978 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240117:0:21956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345978 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240133:0:21956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc200 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587462.240139:0:21956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345978 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240146:0:21956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345978 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240157:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:1.0:1788587462.240160:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587462.240163:0:21956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345978 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240177:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc200/0x419e1ae1f6345978 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240187:0:21956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634597f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd036438e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240192:0:21956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634597f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd036438e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240197:0:21956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634597f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd036438e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240201:0:21956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482600 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:1.0:1788587462.240204:0:21956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634597f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd036438e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240209:0:21956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634597f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd036438e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240216:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xd036438e (ffff8cbf02c72d00) 00010000:00010000:1.0:1788587462.240218:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587462.240221:0:21956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634597f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd036438e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.240226:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634597f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd036438e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587462.240553:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+29:19047:x1875469292175232:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 2507us (6189us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587462.240562:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:3.0:1788587462.244450:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587462.244720:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292175360 00000100:00100000:0.0:1788587462.244729:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292175360 00000100:00100000:0.0:1788587462.244790:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:0.0:1788587462.244829:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+29:19047:x1875469292175360:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587462.244848:0:21957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587462.244870:0:21957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19600/0x419e1ae1f6345986 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ed5 expref: -99 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.244904:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f634598d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.244916:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f634598d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.244940:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f634598d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.245025:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19600/0x419e1ae1f6345986 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ed5 expref: 31 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.245043:0:21957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c19c00/0x419e1ae1f634598d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ed5 expref: 30 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.245051:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:0.0:1788587462.245054:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587462.245058:0:21957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf40c19c00, rc 0) 00000100:00100000:0.0:1788587462.245116:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+30:19047:x1875469292175360:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 289us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587462.245944:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:3.0:1788587462.250854:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587462.251044:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292175616 00000100:00100000:2.0:1788587462.251054:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292175616 00000100:00100000:2.0:1788587462.251102:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:2.0:1788587462.251111:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+30:19047:x1875469292175616:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587462.251192:0:23996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.251210:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.251225:0:23996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587462.251631:0:23996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1788587462.251641:0:23996:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 660000846075ns, next at 661000843665ns, rc = 0 00000004:00010000:2.0:1788587462.251723:0:23996:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dcc23ff reply state 000000003a0d1920 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.251737:0:23996:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.251745:0:23996:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:2.0:1788587462.251760:0:23996:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788587462.251763:0:23996:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587462.251877:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+32:19047:x1875469292175616:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 765us (1079us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788587462.251885:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 55 00000100:00100000:3.0:1788587462.254788:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.255164:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292175744 00000100:00100000:1.0:1788587462.255174:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292175744 00000100:00100000:1.0:1788587462.255221:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:1.0:1788587462.255230:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+32:19047:x1875469292175744:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587462.255262:0:21957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587462.255281:0:21957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634599b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5edc expref: -99 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.255337:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634599b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5edc expref: 33 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.255354:0:21957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634599b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5edc expref: 33 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.255373:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:1.0:1788587462.255376:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587462.255380:0:21957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482600, rc 0) 00000100:00100000:1.0:1788587462.255435:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+33:19047:x1875469292175744:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 206us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587462.255441:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 56 00000100:00100000:3.0:1788587462.260828:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.261123:0:24058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292175872 00000100:00100000:1.0:1788587462.261132:0:24058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292175872 00000100:00100000:1.0:1788587462.261240:0:24058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00100000:1.0:1788587462.261258:0:24058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2410:x1875469292175872:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788587462.261594:0:24058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf36f29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:2410:x1875469292175872:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 345us (811us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788587462.261602:0:24058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 22 00000100:00080000:2.0:1788587462.262589:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587462.265410:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587462.265495:0:21958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292176128 00000100:00100000:2.0:1788587462.265503:0:21958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292176128 00000100:00100000:2.0:1788587462.265556:0:21958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:2.0:1788587462.265566:0:21958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+33:19047:x1875469292176128:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788587462.265853:0:21958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+34:19047:x1875469292176128:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 287us (450us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788587462.265862:0:21958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 9 00000100:00100000:3.0:1788587462.267497:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587462.267643:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292176384 00000100:00100000:2.0:1788587462.267652:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292176384 00000100:00100000:2.0:1788587462.267742:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:2.0:1788587462.267752:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+34:19047:x1875469292176384:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788587462.267860:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+34:19047:x1875469292176384:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 109us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587462.267867:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 57 00000100:00100000:3.0:1788587462.271560:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.271683:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292176512 00000100:00100000:1.0:1788587462.271693:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292176512 00000100:00100000:1.0:1788587462.271753:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:1.0:1788587462.271763:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+34:19047:x1875469292176512:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587462.271782:0:21957:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587462.271833:0:21957:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63459a2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5ee3 expref: -99 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.271900:0:21957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f63459a9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.271915:0:21957:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f63459a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.271925:0:21957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f63459a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587462.271959:0:21957:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788587462.271977:0:21957:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f63459a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.272010:0:21957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482a00/0x419e1ae1f63459a2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ee3 expref: 36 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.272028:0:21957:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f63459a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ee3 expref: 35 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.272036:0:21957:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:1.0:1788587462.272039:0:21957:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788587462.272043:0:21957:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03483000, rc 0) 00000100:00100000:1.0:1788587462.272116:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+35:19047:x1875469292176512:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 353us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587462.272123:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 58 00000100:00100000:0.0:1788587462.279188:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.279267:0:23267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292176640 00000100:00100000:1.0:1788587462.279275:0:23267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292176640 00000100:00100000:1.0:1788587462.279333:0:23267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:1.0:1788587462.279343:0:23267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:2409:x1875469292176640:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587462.279360:0:23267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587462.279378:0:23267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f63459b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1a59a2bc84cd5eea expref: -99 pid: 23267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587462.279404:0:23267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9badc6, blocks: 0x1 00010000:00010000:1.0:1788587462.279422:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=660s v=(0 0) 00010000:00010000:1.0:1788587462.279427:0:23267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587462.279435:0:23267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f63459b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eea expref: 7 pid: 23267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.279454:0:23267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f63459b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eea expref: 7 pid: 23267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.279467:0:23267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbf03482400, rc 0) 00000100:00100000:1.0:1788587462.279523:0:23267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:2409:x1875469292176640:12345-192.168.203.14@tcp:101:lhsmtool_posix.0 Request processed in 181us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587462.279530:0:23267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 23 00000100:00100000:2.0:1788587462.283529:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.284046:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292176896 00000100:00100000:1.0:1788587462.284057:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292176896 00000100:00100000:0.0:1788587462.284676:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:0.0:1788587462.284687:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+35:19047:x1875469292176896:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587462.284824:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+35:19047:x1875469292176896:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 138us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587462.284832:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 59 00000100:00100000:3.0:1788587462.287784:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.288016:0:21957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292177024 00000100:00100000:1.0:1788587462.288025:0:21957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292177024 00000100:00100000:1.0:1788587462.288077:0:21957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:1.0:1788587462.288086:0:21957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+35:19047:x1875469292177024:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788587462.388681:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901907 is committed 00000001:00080000:0.0:1788587462.388711:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901908 is committed 00000001:00080000:0.0:1788587462.388734:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:0.0:1788587462.388743:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1788587462.388762:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788587462.388851:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388873:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388880:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388886:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587462.388891:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388899:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388914:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8cbf02c76700) 00010000:00010000:3.0:1788587462.388917:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587462.388923:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388930:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27e00/0x419e1ae1f63457b1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388955:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388961:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388967:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388972:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587462.388982:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388988:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.388996:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:3.0:1788587462.388998:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587462.389001:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389007:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26400/0x419e1ae1f63457b8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389027:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389033:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389038:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389042:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cc000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587462.389045:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389050:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389057:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8cbf02c72400) 00010000:00010000:3.0:1788587462.389059:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587462.389069:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389075:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cc000/0x419e1ae1f634586e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389102:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389110:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389116:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389121:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf0499ec00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587462.389124:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389129:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389231:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:3.0:1788587462.389234:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587462.389238:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389244:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499ec00/0x419e1ae1f634591d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389274:0:3459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389291:0:3459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389298:0:3459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389304:0:3459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587462.389307:0:3459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389314:0:3459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389322:0:3459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:3.0:1788587462.389324:0:3459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788587462.389328:0:3459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.389334:0:3459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f6345994 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587462.389466:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587462.389481:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310103296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788587462.389654:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587462.389739:0:24056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310103296 00000100:00100000:0.0:1788587462.389746:0:24056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310103296 00000100:00100000:0.0:1788587462.389823:0:24056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587462.389833:0:24056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310103296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788587462.389980:0:24056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788587462.389984:0:24056:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788587462.389986:0:24056:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788587462.389988:0:24056:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788587462 -> 1788587462 00002000:00010000:0.0:1788587462.389991:0:24056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788587462.390029:0:24056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3473:x1875469310103296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (376us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788587462.390037:0:24056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788587462.390336:0:3458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.390345:0:3458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.390352:0:3458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.390366:0:3458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26a00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587462.390370:0:3458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.390377:0:3458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.390389:0:3458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8cbf02c76300) 00010000:00010000:2.0:1788587462.390391:0:3458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788587462.390395:0:3458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.390401:0:3458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f26a00/0x419e1ae1f634580c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23996 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587462.392105:0:3473:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbf3fdb2300/2, rc 0, transno 12884901892 00000100:00100000:3.0:1788587462.392119:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310103296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788587462.393432:0:21957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+14:19047:x1875469292177024:12345-192.168.203.14@tcp:44:lhsmtool_posix.0 Request processed in 105339us (105649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587462.393443:0:21957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 60 00000100:00100000:3.0:1788587462.400204:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587462.400274:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292177152 00000100:00100000:0.0:1788587462.400284:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292177152 00000100:00100000:0.0:1788587462.400344:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:0.0:1788587462.400354:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:2409:x1875469292177152:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788587462.400474:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:2409:x1875469292177152:12345-192.168.203.14@tcp:16:lhsmtool_posix.0 Request processed in 110us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587462.400482:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 25 00000100:00100000:3.0:1788587462.411002:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587462.411196:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292177408 00000100:00100000:0.0:1788587462.411206:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292177408 00000100:00100000:0.0:1788587462.411275:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:0.0:1788587462.411590:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+14:19047:x1875469292177408:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587462.411645:0:21956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587462.411673:0:21956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03483000/0x419e1ae1f63459a9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ee3 expref: 14 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.411709:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:0.0:1788587462.411715:0:21956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587462.411744:0:21956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f63459b7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.411758:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f63459b7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.411768:0:21956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f63459b7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587462.412232:0:21956:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1a367f9 reply state 00000000097ca765 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f63459b7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.412245:0:21956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf40c18e00/0x419e1ae1f63459b7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.412262:0:21956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:0.0:1788587462.412265:0:21956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788587462.412268:0:21956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587462.412584:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+15:19047:x1875469292177408:12345-192.168.203.14@tcp:36:lhsmtool_posix.0 Request processed in 996us (1591us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788587462.412593:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 61 00000100:00100000:3.0:1788587462.415110:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587462.415235:0:23265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292177536 00000100:00100000:0.0:1788587462.415245:0:23265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292177536 00000100:00100000:0.0:1788587462.415385:0:23265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:0.0:1788587462.415396:0:23265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf046bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:2409:x1875469292177536:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788587462.415577:0:23265:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788587462.415587:0:23265:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788587461 00002000:00010000:0.0:1788587462.415589:0:23265:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788587461 00002000:00010000:0.0:1788587462.415592:0:23265:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788587462 -> 1788587461 00002000:00010000:0.0:1788587462.415594:0:23265:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788587462.415655:0:23265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf046bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+8:2409:x1875469292177536:12345-192.168.203.14@tcp:2:lhsmtool_posix.0 Request processed in 262us (552us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788587462.415663:0:23265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 26 00000100:00100000:1.0:1788587462.428189:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587462.428348:0:24058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292177664 00000100:00100000:3.0:1788587462.428359:0:24058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292177664 00000100:00100000:3.0:1788587462.428423:0:24058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:3.0:1788587462.428434:0:24058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc3138d6-3c05-4ca5-96dc-2f3434542c99+8:2410:x1875469292177664:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788587462.428483:0:24058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000742c235b/0x419e1ae1f63459be lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.428502:0:24058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587462.428506:0:24058:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587462.428512:0:24058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000742c235b/0x419e1ae1f63459be lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.428528:0:24058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000742c235b/0x419e1ae1f63459be lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.428557:0:24058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000742c235b/0x419e1ae1f63459be lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.428566:0:24058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000742c235b/0x419e1ae1f63459be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.428575:0:24058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000742c235b/0x419e1ae1f63459be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.428582:0:24058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587462.428588:0:24058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000742c235b/0x419e1ae1f63459be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.428616:0:24058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000742c235b/0x419e1ae1f63459be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.428631:0:24058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000742c235b/0x419e1ae1f63459be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.428640:0:24058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000742c235b/0x419e1ae1f63459be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587462.428728:0:24058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bc3138d6-3c05-4ca5-96dc-2f3434542c99+8:2410:x1875469292177664:12345-192.168.203.14@tcp:1:lhsmtool_posix.0 Request processed in 295us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587462.429140:0:24058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 27 00000100:00100000:0.0:1788587462.435890:0:3465:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587462.435968:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292177920 00000100:00100000:2.0:1788587462.435978:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292177920 00000100:00100000:2.0:1788587462.436037:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 62 00000100:00100000:2.0:1788587462.436048:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+15:19047:x1875469292177920:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788587462.436129:0:21955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63459c5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.436158:0:21955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63459c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.436171:0:21955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63459c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.436607:0:21955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.436621:0:21955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634599b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5edc expref: 16 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.436631:0:21955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.436665:0:21955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634599b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5edc expref: 16 pid: 21957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.436679:0:21955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634599b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5edc expref: 16 pid: 21957 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587462.436693:0:21955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21955:1875469310103424:192.168.203.14@tcp:104: 00000100:00100000:2.0:1788587462.436781:0:21955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0658f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587462.441951:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.442177:0:21940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292178048 00000100:00100000:1.0:1788587462.442187:0:21940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292178048 00010000:00010000:1.0:1788587462.442228:0:21940:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634599b lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5edc expref: 17 pid: 21957 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587462.442350:0:21942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 19 00000100:00100000:3.0:1788587462.442363:0:21942:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+17:2409:x1875469292178048:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587462.442376:0:21942:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587462.442384:0:21942:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634599b lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5edc expref: 17 pid: 21957 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.442397:0:21942:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634599b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5edc expref: 17 pid: 21957 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.442418:0:21942:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:3.0:1788587462.442424:0:21942:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.442445:0:21942:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.442452:0:21942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.442496:0:21955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf03482600/0x419e1ae1f634599b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5edc expref: 17 pid: 21957 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587462.442515:0:21955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21955:1875469310103424:192.168.203.14@tcp:104: 00010000:00010000:2.0:1788587462.442537:0:21955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.442541:0:21942:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587462.442549:0:21955:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.442556:0:21955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587462.442597:0:21942:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+16:2409:x1875469292178048:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 236us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587462.442605:0:21942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 19 00000001:00080000:2.0:1788587462.442738:0:21955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:2.0:1788587462.442936:0:21955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1788587462.442984:0:21955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:2.0:1788587462.443061:0:21955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe05c1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:21955:1875469310103552:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788587462.443109:0:21955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587462.443131:0:21955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf0556d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587462.443239:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310103552 00000100:00100000:1.0:1788587462.443245:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310103552 00000100:00100000:1.0:1788587462.443362:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788587462.443371:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:21955:x1875469310103552:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788587462.443433:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:21955:x1875469310103552:12345-0@lo:1000:mdt00_000.0 Request processed in 64us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587462.443440:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788587462.443502:0:21955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe05c1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:21955:1875469310103552:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788587462.444736:0:21955:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1788587462.444843:0:21955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf340c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:21955:1875469310103680:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788587462.444896:0:21955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587462.444915:0:21955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf03634540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587462.446412:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310103680 00000100:00100000:0.0:1788587462.446424:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310103680 00000100:00100000:0.0:1788587462.446484:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587462.446494:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf340c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:21955:x1875469310103680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788587462.446728:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf340c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:21955:x1875469310103680:12345-0@lo:1000:mdt00_000.0 Request processed in 235us (1830us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788587462.446737:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788587462.446832:0:21955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf340c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:21955:1875469310103680:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788587462.446870:0:21955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446878:0:21955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446884:0:21955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446888:0:21955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf35dfe000 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587462.446891:0:21955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446897:0:21955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446910:0:21955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:3.0:1788587462.446912:0:21955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587462.446924:0:21955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446929:0:21955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe000/0x419e1ae1f63459cc lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446957:0:21955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446961:0:21955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446964:0:21955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446967:0:21955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf421cce00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:3.0:1788587462.446969:0:21955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446972:0:21955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446976:0:21955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:3.0:1788587462.446978:0:21955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587462.446983:0:21955:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345932 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ec0 expref: 19 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446990:0:21955:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345932 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ec0 expref: 19 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.446996:0:21955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345932 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ec0 expref: 19 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.447108:0:21955:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf0499fa00/0x419e1ae1f6345932 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5ec0 expref: 19 pid: 23996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587462.447123:0:21955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21955:1875469310103808:192.168.203.14@tcp:105: 00000100:00100000:0.0:1788587462.447260:0:21955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1873d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587462.455455:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587462.455512:0:21958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292178176 00000100:00100000:3.0:1788587462.455522:0:21958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292178176 00000100:00100000:3.0:1788587462.455582:0:21958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:3.0:1788587462.455592:0:21958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf04960c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+20:19046:x1875469292178176:12345-192.168.203.14@tcp:49:dd.0 00000100:00100000:3.0:1788587462.455745:0:21958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf04960c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+20:19046:x1875469292178176:12345-192.168.203.14@tcp:49:dd.0 Request processed in 146us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587462.455754:0:21958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 10 00000100:00100000:2.0:1788587462.460609:0:21955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:21955:1875469310103808:192.168.203.14@tcp:105: 00010000:00010000:2.0:1788587462.460644:0:21955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460656:0:21955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf421cce00/0x419e1ae1f634592b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460691:0:21955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe400/0x419e1ae1f63459d3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460705:0:21955:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe400/0x419e1ae1f63459d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460717:0:21955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe400/0x419e1ae1f63459d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460726:0:21955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe400/0x419e1ae1f63459d3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460746:0:21955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe400/0x419e1ae1f63459d3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460753:0:21955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe400/0x419e1ae1f63459d3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460758:0:21955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf35dfe400 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587462.460763:0:21955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe400/0x419e1ae1f63459d3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460771:0:21955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe400/0x419e1ae1f63459d3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460783:0:21955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:2.0:1788587462.460786:0:21955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587462.460790:0:21955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe400/0x419e1ae1f63459d3 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460934:0:21955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf35dfe400/0x419e1ae1f63459d3 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460946:0:21955:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63459c5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460952:0:21955:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63459c5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460957:0:21955:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63459c5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460962:0:21955:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf42044e00 already unused, calling callback (ffffffffc21184f0) 00010000:00010000:2.0:1788587462.460971:0:21955:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63459c5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460978:0:21955:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63459c5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460987:0:21955:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8cbf02c72800) 00010000:00010000:2.0:1788587462.460990:0:21955:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587462.460993:0:21955:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63459c5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.460999:0:21955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbf42044e00/0x419e1ae1f63459c5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587462.461744:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+19:19047:x1875469292177920:12345-192.168.203.14@tcp:57:lhsmtool_posix.0 Request processed in 25692us (25856us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788587462.461754:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 62 00000020:00080000:2.0:1788587462.461760:0:21955:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788587462.461970:0:21990:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788587462.461975:0:21990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587462.462004:0:21990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788587462.462014:0:21990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788587462.466616:0:3467:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587462.467636:0:21958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292178432 00000100:00100000:3.0:1788587462.467648:0:21958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292178432 00000100:00100000:3.0:1788587462.467712:0:21958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 11 00000100:00100000:3.0:1788587462.467723:0:21958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+19:19047:x1875469292178432:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788587462.468741:0:21958:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788587462.468908:0:21958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1788587462.468955:0:21958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f63459da lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.468971:0:21958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f63459da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 21958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.468983:0:21958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f63459da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 21958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.468992:0:21958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f63459da lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 21958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.468998:0:21958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f63459da lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 21958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.469015:0:21958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f63459da lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 21958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.469090:0:21958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788587462.469263:0:21958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+21:19047:x1875469292178432:12345-192.168.203.14@tcp:35:lhsmtool_posix.0 Request processed in 1539us (2653us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1788587462.469272:0:21958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 11 00000020:00080000:3.0:1788587462.469284:0:21958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788587462.473706:0:24062:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587462.473721:0:24062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f63459da lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 21958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.473732:0:24062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587462.473736:0:24062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f63459da lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 21958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.473747:0:24062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f63459da lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 21958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.473766:0:24062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8cbf2c8be000) 00010000:00010000:2.0:1788587462.473769:0:24062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587462.473818:0:24062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f63459da lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 21958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.473825:0:24062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe05f27000/0x419e1ae1f63459da lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 21958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.473850:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587462.473852:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587462.473854:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587462.493987:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.494023:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:1.0:1788587462.494378:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587462.501585:0:23271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292178560 00000100:00100000:0.0:1788587462.501615:0:23271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292178560 00000100:00100000:0.0:1788587462.501680:0:23271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292178688 00000100:00100000:0.0:1788587462.501684:0:23271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292178688 00000100:00100000:0.0:1788587462.501698:0:23271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292178816 00000100:00100000:0.0:1788587462.501701:0:23271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292178816 00000100:00100000:0.0:1788587462.501723:0:23271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:0.0:1788587462.501733:0:23271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+10:2409:x1875469292178560:12345-192.168.203.14@tcp:4:dd.0 00010000:00010000:0.0:1788587462.501767:0:23271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.501787:0:23271:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f63459b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eea expref: 10 pid: 23267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.501811:0:23271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587462.501815:0:23271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587462.501820:0:23271:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.501856:0:23271:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f63459b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eea expref: 10 pid: 23267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.501870:0:23271:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f63459b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eea expref: 10 pid: 23267 timeout: 760 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587462.501884:0:23271:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:23271:1875469310103936:192.168.203.14@tcp:104: 00000100:00100000:0.0:1788587462.501973:0:23271:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbf1873db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587462.505106:0:23271:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:23271:1875469310103936:192.168.203.14@tcp:104: 00010000:00010000:0.0:1788587462.505156:0:23271:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587462.506377:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587462.506662:0:21941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292178944 00000100:00100000:0.0:1788587462.506671:0:21941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292178944 00010000:00010000:0.0:1788587462.506709:0:21941:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f63459b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eea expref: 11 pid: 23267 timeout: 760 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587462.506752:0:21941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 20 00000100:00100000:0.0:1788587462.506762:0:21941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+11:2409:x1875469292178944:12345-192.168.203.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587462.506776:0:21941:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587462.506847:0:21941:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f63459b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eea expref: 11 pid: 23267 timeout: 760 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.506860:0:21941:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f63459b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eea expref: 11 pid: 23267 timeout: 760 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.506884:0:21941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004679ed6d/0x419e1ae1f63459b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.14@tcp remote: 0x1a59a2bc84cd5eea expref: 11 pid: 23267 timeout: 760 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.506901:0:21941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587462.506904:0:21941:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587462.506910:0:21941:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.506919:0:21941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.506965:0:21941:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587462.507006:0:23271:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587462.507017:0:21941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+10:2409:x1875469292178944:12345-192.168.203.14@tcp:103:ldlm_bl.0 Request processed in 254us (643us total) trans 0 rc 0/0 00010000:00010000:3.0:1788587462.507020:0:23271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587462.507030:0:21941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 20 00002000:00010000:1.0:1788587462.599659:0:23271:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1788587462.599667:0:23271:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788587461 -> 1788587462 00002000:00010000:1.0:1788587462.599670:0:23271:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1788587462.599684:0:23271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.599715:0:23271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.599724:0:23271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.599731:0:23271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c18000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:1.0:1788587462.599736:0:23271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.599745:0:23271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.599762:0:23271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.599769:0:23271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4fc665a/0x419e1ae1f63459e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587462.599909:0:23271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+11:2409:x1875469292178560:12345-192.168.203.14@tcp:4:dd.0 Request processed in 98172us (105926us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788587462.599922:0:23271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 0 00000100:00100000:1.0:1788587462.599953:0:23271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:1.0:1788587462.599963:0:23271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+10:2409:x1875469292178688:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:1.0:1788587462.599997:0:23271:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 1048576, mtime: 0x6a9badc6, atime: 0x6a9badc5, ctime: 0x0, blocks: 0x803 00010000:00010000:1.0:1788587462.600009:0:23271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f63459e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.600020:0:23271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=660s v=(0 0) 00010000:00010000:1.0:1788587462.600024:0:23271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587462.600030:0:23271:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f63459e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587462.600043:0:23271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f63459e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587462.602635:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000001:00080000:1.0:1788587462.602655:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00000001:00080000:1.0:1788587462.602670:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:1.0:1788587462.733016:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:3.0:1788587462.735817:0:23271:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 1048576 -> 3145728 00002000:00010000:3.0:1788587462.735827:0:23271:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1788587462.735842:0:23271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f63459e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.735854:0:23271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f63459e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.735863:0:23271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f63459e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.735870:0:23271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf03482c00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587462.735875:0:23271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f63459e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.736022:0:23271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f63459e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.736041:0:23271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f63459e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.736047:0:23271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc48c4b3/0x419e1ae1f63459e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587462.736151:0:23271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+6:2409:x1875469292178688:12345-192.168.203.14@tcp:4:dd.0 Request processed in 136185us (242121us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788587462.736161:0:23271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 1 00000100:00100000:3.0:1788587462.736192:0:23271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:3.0:1788587462.736203:0:23271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2412:x1875469292178816:12345-192.168.203.14@tcp:4:dd.0 00002000:00010000:3.0:1788587462.736240:0:23271:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 3145728, mtime: 0x6a9badc6, atime: 0x6a9badc5, ctime: 0x0, blocks: 0x1007 00010000:00010000:3.0:1788587462.736256:0:23271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de8144d0/0x419e1ae1f63459ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.736267:0:23271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=660s v=(0 0) 00010000:00010000:3.0:1788587462.736272:0:23271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587462.736277:0:23271:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de8144d0/0x419e1ae1f63459ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.736288:0:23271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de8144d0/0x419e1ae1f63459ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587462.754840:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587462.754975:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587462.760391:0:23272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587462.761601:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587462.761671:0:23270:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788587462.762673:0:23272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788587462.766413:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587462.766441:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587462.766481:0:23272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292179072 00000100:00100000:2.0:1788587462.766489:0:23272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292179072 00000100:00100000:2.0:1788587462.766545:0:23272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587462.766553:0:23272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292179200 00000100:00100000:2.0:1788587462.766556:0:23272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292179200 00000100:00100000:2.0:1788587462.766570:0:23272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587462.766574:0:23272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292179328 00000100:00100000:2.0:1788587462.766577:0:23272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292179328 00000100:00100000:2.0:1788587462.766589:0:23272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587462.766593:0:23272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292179456 00000100:00100000:2.0:1788587462.766595:0:23272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292179456 00000100:00100000:2.0:1788587462.766606:0:23272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587462.766611:0:23272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292179584 00000100:00100000:2.0:1788587462.766613:0:23272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292179584 00000100:00100000:2.0:1788587462.770341:0:24732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:2.0:1788587462.770360:0:24732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+13:2411:x1875469292179072:12345-192.168.203.14@tcp:4:dd.0 00010000:00010000:2.0:1788587462.770398:0:24732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003da7acc8/0x419e1ae1f63459f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.770425:0:24732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587462.770430:0:24732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587462.770436:0:24732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003da7acc8/0x419e1ae1f63459f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587462.770450:0:24732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003da7acc8/0x419e1ae1f63459f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587462.865524:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00002000:00010000:3.0:1788587462.867048:0:23271:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1788587462.867056:0:23271:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788587462.867070:0:23271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de8144d0/0x419e1ae1f63459ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.867083:0:23271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de8144d0/0x419e1ae1f63459ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.867091:0:23271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de8144d0/0x419e1ae1f63459ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.867098:0:23271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26400 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587462.867104:0:23271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de8144d0/0x419e1ae1f63459ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.867113:0:23271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de8144d0/0x419e1ae1f63459ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.867141:0:23271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de8144d0/0x419e1ae1f63459ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.867149:0:23271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de8144d0/0x419e1ae1f63459ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587462.867255:0:23271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+13:2412:x1875469292178816:12345-192.168.203.14@tcp:4:dd.0 Request processed in 131040us (372862us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788587462.867280:0:23271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 2 00000100:00100000:3.0:1788587462.867313:0:23271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:3.0:1788587462.867323:0:23271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe05c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+12:2412:x1875469292179200:12345-192.168.203.14@tcp:4:dd.0 00010000:00010000:3.0:1788587462.867354:0:23271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f63459fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.867366:0:23271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587462.867370:0:23271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587462.867375:0:23271:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f63459fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.867388:0:23271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f63459fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587462.912753:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587462.963596:0:24732:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1788587462.963606:0:24732:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1788587462.963621:0:24732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003da7acc8/0x419e1ae1f63459f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.963635:0:24732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003da7acc8/0x419e1ae1f63459f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.963644:0:24732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003da7acc8/0x419e1ae1f63459f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.963650:0:24732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf35dffc00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587462.963655:0:24732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003da7acc8/0x419e1ae1f63459f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.963664:0:24732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003da7acc8/0x419e1ae1f63459f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.963684:0:24732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003da7acc8/0x419e1ae1f63459f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.963706:0:24732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003da7acc8/0x419e1ae1f63459f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587462.963834:0:24732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+14:2411:x1875469292179072:12345-192.168.203.14@tcp:4:dd.0 Request processed in 193475us (208997us total) trans 12884901898 rc 0/0 00000100:00100000:0.0:1788587462.963844:0:24732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 3 00000100:00100000:0.0:1788587462.963875:0:24732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:0.0:1788587462.963886:0:24732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+13:2411:x1875469292179328:12345-192.168.203.14@tcp:4:dd.0 00010000:00010000:0.0:1788587462.963918:0:24732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f6345a04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.963930:0:24732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587462.963934:0:24732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587462.963940:0:24732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f6345a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587462.963952:0:24732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f6345a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587462.966190:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901898 is committed 00000001:00080000:3.0:1788587463.023439:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901899 is committed 00002000:00010000:3.0:1788587463.032894:0:23271:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1788587463.032905:0:23271:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1788587463.032920:0:23271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f63459fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587463.032934:0:23271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f63459fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587463.032944:0:23271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f63459fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587463.032967:0:23271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f27e00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:3.0:1788587463.032972:0:23271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f63459fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587463.032982:0:23271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f63459fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587463.033001:0:23271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f63459fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587463.033356:0:23271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f66674/0x419e1ae1f63459fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587463.033456:0:23271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe05c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+11:2412:x1875469292179200:12345-192.168.203.14@tcp:4:dd.0 Request processed in 166131us (278476us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1788587463.033466:0:23271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 4 00000100:00100000:3.0:1788587463.033498:0:23271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 6 00000100:00100000:3.0:1788587463.033510:0:23271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+10:2412:x1875469292179456:12345-192.168.203.14@tcp:4:dd.0 00010000:00010000:3.0:1788587463.034750:0:23271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394258d5/0x419e1ae1f6345a0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587463.034770:0:23271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587463.034775:0:23271:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587463.034781:0:23271:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000394258d5/0x419e1ae1f6345a0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587463.034832:0:23271:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000394258d5/0x419e1ae1f6345a0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587463.083492:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901900 is committed 00002000:00010000:2.0:1788587463.090840:0:24732:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1788587463.090850:0:24732:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1788587463.090870:0:24732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f6345a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.091199:0:24732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f6345a04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.091212:0:24732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f6345a04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.091219:0:24732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf40c19000 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587463.091224:0:24732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f6345a04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.091233:0:24732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f6345a04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.091287:0:24732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f6345a04 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.091295:0:24732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdc557d9/0x419e1ae1f6345a04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587463.091392:0:24732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+10:2411:x1875469292179328:12345-192.168.203.14@tcp:4:dd.0 Request processed in 127502us (329792us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788587463.091403:0:24732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 5 00000100:00100000:2.0:1788587463.094343:0:24732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 7 00000100:00100000:2.0:1788587463.094454:0:24732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+9:2412:x1875469292179584:12345-192.168.203.14@tcp:4:dd.0 00010000:00010000:2.0:1788587463.094495:0:24732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001274c424/0x419e1ae1f6345a12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.094513:0:24732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587463.094517:0:24732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587463.094558:0:24732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001274c424/0x419e1ae1f6345a12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.094574:0:24732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001274c424/0x419e1ae1f6345a12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587463.142074:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901901 is committed 00010000:00010000:0.0:1788587463.142645:0:23271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394258d5/0x419e1ae1f6345a0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587463.142660:0:23271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000394258d5/0x419e1ae1f6345a0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587463.142685:0:23271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000394258d5/0x419e1ae1f6345a0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587463.142692:0:23271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe05f26600 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:0.0:1788587463.142696:0:23271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000394258d5/0x419e1ae1f6345a0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587463.142706:0:23271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000394258d5/0x419e1ae1f6345a0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587463.142723:0:23271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000394258d5/0x419e1ae1f6345a0b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587463.142731:0:23271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000394258d5/0x419e1ae1f6345a0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587463.142864:0:23271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bc3138d6-3c05-4ca5-96dc-2f3434542c99+9:2412:x1875469292179456:12345-192.168.203.14@tcp:4:dd.0 Request processed in 109353us (376451us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788587463.142873:0:23271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 6 00002000:00010000:2.0:1788587463.183840:0:24732:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788587463.183859:0:24732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001274c424/0x419e1ae1f6345a12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.183888:0:24732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001274c424/0x419e1ae1f6345a12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.183897:0:24732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001274c424/0x419e1ae1f6345a12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.183904:0:24732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbf35dffe00 already unused, calling callback (ffffffffc16d44f0) 00010000:00010000:2.0:1788587463.183909:0:24732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001274c424/0x419e1ae1f6345a12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.183918:0:24732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001274c424/0x419e1ae1f6345a12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.183936:0:24732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001274c424/0x419e1ae1f6345a12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587463.183944:0:24732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001274c424/0x419e1ae1f6345a12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587463.184052:0:24732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bc3138d6-3c05-4ca5-96dc-2f3434542c99+7:2412:x1875469292179584:12345-192.168.203.14@tcp:4:dd.0 Request processed in 89693us (417605us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788587463.184061:0:24732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 7 00000001:00080000:1.0:1788587463.184327:0:8130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901902 is committed 00000100:00100000:1.0:1788587463.213844:0:3472:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587463.213863:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310104192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788587463.213873:0:3472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3cc5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310104064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788587463.214005:0:3472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587463.214027:0:21960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310104064 00000100:00100000:0.0:1788587463.214036:0:21960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310104064 00000100:00100000:0.0:1788587463.214086:0:21960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587463.214095:0:21960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310104064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788587463.214144:0:21960:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587463.214193:0:21960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3472:x1875469310104064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587463.214211:0:21960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788587463.214511:0:3472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3cc5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3472:1875469310104064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788587463.216255:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587463.216622:0:21961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310104192 00000100:00100000:1.0:1788587463.216630:0:21961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310104192 00000100:00100000:1.0:1788587463.216879:0:21961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788587463.216902:0:21961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310104192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788587463.216940:0:21961:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788587463.217017:0:21961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310104192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587463.217024:0:21961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788587463.218012:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3fdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310104192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788587463.316679:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587463.316724:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:2.0:1788587463.316781:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:3.0:1788587463.317074:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292180224 00000100:00100000:3.0:1788587463.317084:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292180224 00000100:00100000:3.0:1788587463.317148:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:3.0:1788587463.317158:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf1e10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292180224:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587463.317227:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf1e10c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292180224:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 70us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587463.317234:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 52 00000100:00100000:0.0:1788587463.317412:0:21949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292179712 00000100:00100000:0.0:1788587463.317417:0:21949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292179712 00000100:00100000:0.0:1788587463.317456:0:21949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 164 00000100:00100000:1.0:1788587463.317463:0:23267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292179968 00000100:00100000:0.0:1788587463.317466:0:21949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:2409:x1875469292179712:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:1.0:1788587463.317470:0:23267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292179968 00000100:00100000:1.0:1788587463.317505:0:23267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00100000:0.0:1788587463.317511:0:21949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75e0a861-ef0e-4e22-a4af-fd213f1f8b58+13:2409:x1875469292179712:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 45us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587463.317519:0:23267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2409:x1875469292179968:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587463.317526:0:21949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 164 00000100:00100000:1.0:1788587463.317559:0:23267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf34a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2409:x1875469292179968:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 44us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587463.317566:0:23267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 15 00000100:00080000:2.0:1788587463.318362:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587463.318369:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788587463.318473:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587463.318507:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587463.318534:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587463.318610:0:3466:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.14@tcp (source: 12345-192.168.203.14@tcp) 00000100:00100000:0.0:1788587463.318631:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292180480 00000100:00100000:0.0:1788587463.318637:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292180480 00000100:00100000:0.0:1788587463.318680:0:23264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292180352 00000100:00100000:0.0:1788587463.318684:0:23264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292180352 00000100:00100000:0.0:1788587463.318704:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:0.0:1788587463.318712:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292180480:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587463.318753:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292180480:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587463.318759:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 16 00000100:00100000:0.0:1788587463.318774:0:23264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00100000:0.0:1788587463.318780:0:23264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292180352:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:0.0:1788587463.319106:0:23264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+5:2409:x1875469292180352:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 324us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587463.319129:0:23264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 17 00000100:00080000:0.0:1788587463.322603:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587463.322618:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587463.322858:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292179840 00000100:00100000:3.0:1788587463.322870:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292179840 00000100:00100000:3.0:1788587463.322946:0:21955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469292180096 00000100:00100000:3.0:1788587463.322950:0:21955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469292180096 00000100:00100000:3.0:1788587463.322978:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:3.0:1788587463.322987:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2409:x1875469292179840:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587463.323057:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bc3138d6-3c05-4ca5-96dc-2f3434542c99+5:2409:x1875469292179840:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 70us (4548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587463.323063:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 53 00000100:00100000:3.0:1788587463.323081:0:21955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00100000:3.0:1788587463.323087:0:21955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3d8bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+6:2409:x1875469292180096:12345-192.168.203.14@tcp:400:kworker.0 00000100:00100000:3.0:1788587463.323125:0:21955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3d8bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ddd9e77-7692-4352-87e9-0155c2125e90+6:2409:x1875469292180096:12345-192.168.203.14@tcp:400:kworker.0 Request processed in 39us (4591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587463.323131:0:21955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.14@tcp, seq: 54 00000100:00080000:1.0:1788587463.323383:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587463.323387:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587463.723300:0:3474:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587463.723321:0:3474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310104320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587463.723384:0:3474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587463.723603:0:23268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310104320 00000100:00100000:0.0:1788587463.723612:0:23268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310104320 00000100:00100000:0.0:1788587463.723678:0:23268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587463.723687:0:23268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310104320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587463.723723:0:23268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587463.723783:0:23268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3474:x1875469310104320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587463.723789:0:23268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788587463.724168:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587463.724180:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310104448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788587463.724221:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587463.724332:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310104832:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.724359:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587463.724376:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310105344:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.724399:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587463.724414:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469310105856:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.724432:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587463.724448:0:3475:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788587463.724927:0:24056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310104832 00000100:00100000:3.0:1788587463.724935:0:24056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310104832 00000100:00100000:3.0:1788587463.724984:0:24056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788587463.724992:0:24056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf1e10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310104832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725038:0:24056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf1e10d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310104832:12345-0@lo:400:kworker.0 Request processed in 46us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587463.725045:0:24056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788587463.725067:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310105344 00000100:00100000:3.0:1788587463.725070:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310105344 00000100:00100000:3.0:1788587463.725093:0:23996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310105856 00000100:00100000:3.0:1788587463.725095:0:23996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310105856 00000100:00100000:3.0:1788587463.725117:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587463.725123:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf1e10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310105344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725158:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf1e10ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3475:x1875469310105344:12345-0@lo:400:kworker.0 Request processed in 35us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587463.725165:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587463.725176:0:23996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788587463.725181:0:23996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf1e10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469310105856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725223:0:23996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf1e10c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3475:x1875469310105856:12345-0@lo:400:kworker.0 Request processed in 41us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587463.725254:0:23996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788587463.725275:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788587463.725279:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587463.725281:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587463.725320:0:3474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3474:1875469310104320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587463.725367:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3473:1875469310104576:0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725399:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587463.725424:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310105088:0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725448:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587463.725471:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469310105600:0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725492:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587463.725509:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788587463.725515:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310104960:0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725534:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587463.725547:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469310105472:0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725564:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587463.725583:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310105600 00000100:00100000:3.0:1788587463.725587:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310105600 00000100:00100000:3.0:1788587463.725609:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310104960 00000100:00100000:3.0:1788587463.725612:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310104960 00000100:00100000:3.0:1788587463.725625:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310105472 00000100:00100000:3.0:1788587463.725627:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310105472 00000100:00100000:3.0:1788587463.725641:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788587463.725647:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469310105600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725687:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3473:x1875469310105600:12345-0@lo:400:kworker.0 Request processed in 39us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587463.725702:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788587463.725715:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788587463.725720:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310104960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725748:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3473:x1875469310104960:12345-0@lo:400:kworker.0 Request processed in 28us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587463.725754:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788587463.725764:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788587463.725769:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469310105472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725792:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3473:x1875469310105472:12345-0@lo:400:kworker.0 Request processed in 22us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587463.725822:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788587463.725835:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587463.725838:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788587463.725856:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3473:1875469310104960:0@lo:400:kworker.0 00000100:00100000:3.0:1788587463.725865:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3473:1875469310105472:0@lo:400:kworker.0 00010000:00080000:3.0:1788587463.725875:0:3473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf1e10c700 x1875469310105600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587463.725885:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3473:1875469310105600:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.726248:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310104704:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.726282:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587463.726308:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310105216:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.726329:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587463.726345:0:3475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf1e10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469310105728:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.726364:0:3475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587463.726386:0:3475:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1788587463.726391:0:3475:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbf3fdb2300, transno 12884901892 00000004:00080000:2.0:1788587463.726401:0:3475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1788587463.726420:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310104832:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.726431:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3475:1875469310105344:0@lo:400:kworker.0 00010000:00080000:2.0:1788587463.726442:0:3475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8cbf1e10f800 x1875469310105856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587463.726588:0:24465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310104448 00000100:00100000:1.0:1788587463.726594:0:24465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310104448 00000100:00100000:1.0:1788587463.726644:0:24465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587463.726652:0:24465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf1e10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310104448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788587463.726669:0:24465:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 64552960 pending 0 free 3851419648 avail 3840933888 00000100:00100000:1.0:1788587463.726710:0:24465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf1e10d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310104448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587463.726716:0:24465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587463.726747:0:21947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310104576 00000100:00100000:1.0:1788587463.726750:0:21947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310104576 00000100:00100000:1.0:1788587463.726771:0:21947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788587463.726777:0:21947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf366dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:3473:x1875469310104576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587463.726824:0:21947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf366dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049+24:3473:x1875469310104576:12345-0@lo:400:kworker.0 Request processed in 47us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587463.726831:0:21947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788587463.726866:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310105088 00000100:00100000:1.0:1788587463.726870:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310105088 00000100:00100000:1.0:1788587463.726890:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310104704 00000100:00100000:1.0:1788587463.726893:0:22600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310104704 00000100:00100000:1.0:1788587463.726907:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788587463.726913:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3fdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310105088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587463.726945:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3fdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310105088:12345-0@lo:400:kworker.0 Request processed in 31us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587463.726951:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788587463.726962:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788587463.726968:0:22600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf1e10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310104704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587463.726993:0:22600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf1e10df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3475:x1875469310104704:12345-0@lo:400:kworker.0 Request processed in 25us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587463.726999:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788587463.727012:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587463.727022:0:23267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310105216 00000100:00100000:1.0:1788587463.727025:0:23267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310105216 00000100:00100000:1.0:1788587463.727050:0:23267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788587463.727056:0:23267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf1e10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310105216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587463.727083:0:23267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf1e10c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3475:x1875469310105216:12345-0@lo:400:kworker.0 Request processed in 28us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587463.727089:0:23267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788587463.727103:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587463.727129:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5e8d0f0-1b7c-47a3-bb2e-27bde5bbf049:3473:1875469310104576:0@lo:400:kworker.0 00000100:00100000:1.0:1788587463.727141:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310105088:0@lo:400:kworker.0 00000100:00100000:1.0:1788587463.727157:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310104448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788587463.727214:0:21956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310105728 00000100:00100000:1.0:1788587463.727219:0:21956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310105728 00000100:00100000:1.0:1788587463.727260:0:21956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788587463.727267:0:21956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf1e10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469310105728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587463.727297:0:21956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf1e10fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3475:x1875469310105728:12345-0@lo:400:kworker.0 Request processed in 31us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587463.727304:0:21956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788587463.727317:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587463.728060:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3475:1875469310105856:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.728093:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3475:1875469310104704:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.728105:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3475:1875469310105216:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.728114:0:3475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf1e10e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3475:1875469310105728:0@lo:400:kworker.0 00000100:00100000:2.0:1788587463.729771:0:3473:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587463.729790:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310105984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788587463.729873:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587463.730020:0:23269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310105984 00000100:00100000:0.0:1788587463.730027:0:23269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310105984 00000100:00100000:0.0:1788587463.730076:0:23269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587463.730085:0:23269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf1e10e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310105984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788587463.730106:0:23269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587463.730152:0:23269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf1e10e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3473:x1875469310105984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587463.730160:0:23269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587463.730216:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3473:1875469310105984:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788587463.916303:0:21944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788587464.663659:0:24769:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788587464.938918:0:24062:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587465.968947:0:21943:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587466.286827:0:3473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbf3d8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310106112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587466.286899:0:3473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587466.287680:0:23268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469310106112 00000100:00100000:0.0:1788587466.287689:0:23268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469310106112 00000100:00100000:0.0:1788587466.287761:0:23268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587466.287774:0:23268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbf3cc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310106112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587466.287847:0:23268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 64552960 pending 0 free 3843031040 avail 3840933888 00000100:00100000:0.0:1788587466.287907:0:23268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbf3cc5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3473:x1875469310106112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587466.287915:0:23268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587466.287966:0:3473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbf3d8bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3473:1875469310106112:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788587466.289897:0:21951:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 14295 lines, 14295 kept, 0 dropped, 0 bad.