00010000:00010000:0.0F:1788643054.479079:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1788643055.501896:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1788643055.824070:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696855296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788643055.824151:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643055.824202:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696855296 00000100:00100000:3.0:1788643055.824210:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696855296 00000100:00100000:3.0:1788643055.824271:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788643055.824282:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacfd421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696855296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788643055.824312:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788643055.824367:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacfd421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696855296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643055.824374:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788643055.824430:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696855296:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788643055.827463:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788643056.527541:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643056.598658:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0F:1788643056.601525:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675815424 00000100:00100000:2.0:1788643056.601549:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675815424 00000100:00100000:2.0:1788643056.601673:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:2.0:1788643056.601684:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+22:15603:x1875527675815424:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788643056.601791:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+22:15603:x1875527675815424:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 Request processed in 109us (3142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643056.601800:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00080000:3.0:1788643056.606537:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788643056.606695:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643056.606859:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675815552 00000100:00100000:3.0:1788643056.606868:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675815552 00000100:00100000:3.0:1788643056.606938:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00100000:3.0:1788643056.606948:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:15603:x1875527675815552:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788643056.607044:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:15603:x1875527675815552:12345-192.168.206.18@tcp:60:lhsmtool_posix.0 Request processed in 98us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643056.607051:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00080000:0.0:1788643056.607137:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788643056.615100:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643056.615189:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675815808 00000100:00100000:2.0:1788643056.615198:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675815808 00000100:00100000:2.0:1788643056.615254:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:2.0:1788643056.615264:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+22:15603:x1875527675815808:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788643056.615805:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+23:15603:x1875527675815808:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 540us (711us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788643056.615813:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 12 00000001:00080000:3.0:1788643056.623010:0:17173:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:3.0:1788643056.623039:0:17173:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cacfcf7c900 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:3.0:1788643056.623045:0:17173:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cacd0f19b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cacfcf7cb40 00000020:00080000:3.0:1788643056.623048:0:17173:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cacd0f19400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cacfddcb600 00010000:00010000:2.0:1788643056.626730:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc0031800/0x119ccc6e683c3bb8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643056.626747:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc0031800/0x119ccc6e683c3bb8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643056.626755:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc0031800/0x119ccc6e683c3bb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643056.626761:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0031800 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643056.626766:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc0031800/0x119ccc6e683c3bb8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643056.626773:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc0031800/0x119ccc6e683c3bb8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643056.626810:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cacf0655600) 00010000:00010000:2.0:1788643056.626814:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643056.626819:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc0031800/0x119ccc6e683c3bb8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643056.626826:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc0031800/0x119ccc6e683c3bb8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788643056.627478:0:17234:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:0.0:1788643056.627552:0:17234:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1788643056.934140:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643056.934181:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643056.934217:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643056.934248:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643056.934272:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643056.934308:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643056.934350:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643056.934369:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643056.934425:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643056.934450:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675816192 00000100:00100000:0.0:1788643056.934458:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675816192 00000100:00100000:0.0:1788643056.934501:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675816704 00000100:00100000:0.0:1788643056.934504:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675816704 00000100:00100000:0.0:1788643056.934527:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675816064 00000100:00100000:0.0:1788643056.934530:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675816064 00000100:00100000:0.0:1788643056.934540:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675816576 00000100:00100000:0.0:1788643056.934542:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675816576 00000100:00100000:0.0:1788643056.934558:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:0.0:1788643056.934566:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2401:x1875527675816192:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643056.934630:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2401:x1875527675816192:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 65us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643056.934637:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:0.0:1788643056.934655:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:0.0:1788643056.934675:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2401:x1875527675816704:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643056.934715:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2401:x1875527675816704:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 40us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643056.934722:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:0.0:1788643056.934735:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:0.0:1788643056.934741:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+13:2401:x1875527675816064:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643056.934770:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+13:2401:x1875527675816064:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643056.934776:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:0.0:1788643056.934786:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:0.0:1788643056.934792:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371cd762-ea78-4bcd-8c54-d51e9137aa0d+6:2401:x1875527675816576:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643056.934812:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371cd762-ea78-4bcd-8c54-d51e9137aa0d+6:2401:x1875527675816576:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 21us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643056.934818:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:0.0:1788643056.934835:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675816448 00000100:00100000:0.0:1788643056.934839:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675816448 00000100:00100000:0.0:1788643056.934859:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675816960 00000100:00100000:0.0:1788643056.934861:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675816960 00000100:00100000:0.0:1788643056.934871:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675816320 00000100:00100000:0.0:1788643056.934873:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675816320 00000100:00100000:0.0:1788643056.934883:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675816832 00000100:00100000:0.0:1788643056.934886:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675816832 00000100:00100000:0.0:1788643056.934898:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:0.0:1788643056.934904:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2401:x1875527675816448:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643056.934929:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2401:x1875527675816448:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 25us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643056.934941:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:0.0:1788643056.934953:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:0.0:1788643056.934960:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2401:x1875527675816960:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643056.934985:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2401:x1875527675816960:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 26us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643056.934991:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:0.0:1788643056.935001:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:0.0:1788643056.935007:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2401:x1875527675816320:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643056.935027:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2401:x1875527675816320:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 21us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643056.935033:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:0.0:1788643056.935042:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:0.0:1788643056.935048:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2401:x1875527675816832:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643056.935070:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2401:x1875527675816832:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 23us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643056.935076:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00080000:0.0:1788643056.935105:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788643056.935108:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788643056.935111:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788643056.935113:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788643056.936940:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675815936 00000100:00100000:3.0:1788643056.936953:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675815936 00000100:00100000:3.0:1788643056.937018:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 164 00000100:00100000:3.0:1788643056.937025:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc74dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:891f2e95-f232-479d-b61c-ed3545b33d67+13:2401:x1875527675815936:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788643056.937086:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc74dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:891f2e95-f232-479d-b61c-ed3545b33d67+13:2401:x1875527675815936:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 61us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643056.937094:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 164 00000040:00080000:0.0:1788643057.103548:0:17227:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788643057.103556:0:17227:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788643057.103574:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788643057.103585:0:17227:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788643057.548827:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643057.867723:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696855424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788643057.867791:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643057.867865:0:19992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696855424 00000100:00100000:1.0:1788643057.867872:0:19992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696855424 00000100:00100000:1.0:1788643057.867920:0:19992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788643057.867929:0:19992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696855424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788643057.867957:0:19992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788643057.867999:0:19992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696855424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643057.868006:0:19992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788643057.868051:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696855424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788643057.868176:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696855552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788643057.868202:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788643057.868392:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788643057.868470:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01073fa7-a753-425c-8af1-85d79a3a8f8c:3644:1875527696855680:0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.868491:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696855936:0@lo:400:kworker.0 00000100:00100000:2.0:1788643057.868503:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643057.868518:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643057.868524:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875527696856192:0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.868535:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875527696856448:0@lo:400:kworker.0 00000100:00100000:2.0:1788643057.868545:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643057.868556:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696855808:0@lo:400:kworker.0 00000100:00100000:1.0:1788643057.868611:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696855680 00000100:00100000:1.0:1788643057.868615:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696855680 00000100:00100000:1.0:1788643057.868644:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788643057.868651:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc74de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01073fa7-a753-425c-8af1-85d79a3a8f8c+24:3644:x1875527696855680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643057.868683:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc74de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01073fa7-a753-425c-8af1-85d79a3a8f8c+24:3644:x1875527696855680:12345-0@lo:400:kworker.0 Request processed in 33us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643057.868689:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788643057.869167:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875527696856704:0@lo:400:kworker.0 00000100:00100000:2.0:1788643057.869209:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643057.869239:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01073fa7-a753-425c-8af1-85d79a3a8f8c:3644:1875527696855680:0@lo:400:kworker.0 00000100:00100000:2.0:1788643057.869265:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696856064:0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.869269:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643057.869287:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643057.869288:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696856320:0@lo:400:kworker.0 00000100:00100000:2.0:1788643057.869301:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875527696856576:0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.869307:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643057.869320:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643057.869323:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875527696856832:0@lo:400:kworker.0 00000100:00100000:2.0:1788643057.869347:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696857088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788643057.869358:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643057.869398:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643057.869403:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696855808 00000100:00100000:0.0:1788643057.869407:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696855808 00000100:00100000:0.0:1788643057.869452:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696856320 00000100:00100000:0.0:1788643057.869455:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696856320 00000100:00100000:0.0:1788643057.869469:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788643057.869475:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696855808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.869517:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696855808:12345-0@lo:400:kworker.0 Request processed in 42us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643057.869524:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788643057.869540:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788643057.869547:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696856320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.869574:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696856320:12345-0@lo:400:kworker.0 Request processed in 29us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643057.869580:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788643057.869598:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696856192 00000100:00100000:0.0:1788643057.869612:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696856192 00000100:00100000:0.0:1788643057.869629:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696856704 00000100:00100000:0.0:1788643057.869631:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696856704 00000100:00100000:0.0:1788643057.869646:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696856576 00000100:00100000:0.0:1788643057.869648:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696856576 00000100:00100000:0.0:1788643057.869658:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696856832 00000100:00100000:0.0:1788643057.869659:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696856832 00000100:00100000:0.0:1788643057.869671:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788643057.869676:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875527696856192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.869708:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875527696856192:12345-0@lo:400:kworker.0 Request processed in 32us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643057.869713:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788643057.869724:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788643057.869729:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875527696856704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.869755:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875527696856704:12345-0@lo:400:kworker.0 Request processed in 26us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643057.869760:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788643057.869770:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788643057.869775:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875527696856576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.869798:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875527696856576:12345-0@lo:400:kworker.0 Request processed in 23us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643057.869803:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788643057.869813:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788643057.869818:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875527696856832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.869840:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875527696856832:12345-0@lo:400:kworker.0 Request processed in 23us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643057.869846:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788643057.869870:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696855936 00000100:00100000:0.0:1788643057.869874:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696855936 00000100:00100000:0.0:1788643057.869895:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696856064 00000100:00100000:0.0:1788643057.869898:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696856064 00000100:00100000:0.0:1788643057.869915:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788643057.869921:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696855936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.869949:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696855936:12345-0@lo:400:kworker.0 Request processed in 29us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643057.869954:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788643057.869964:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788643057.869970:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696856064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.869994:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696856064:12345-0@lo:400:kworker.0 Request processed in 25us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643057.869999:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788643057.870019:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788643057.870022:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788643057.870024:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788643057.870026:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788643057.870047:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875527696856192:0@lo:400:kworker.0 00010000:00080000:0.0:1788643057.870058:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc6bd5880 x1875527696856704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643057.870068:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875527696856704:0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.870089:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643057.870108:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875527696856960:0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.870129:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643057.870150:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696855936:0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.870174:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696856448 00000100:00100000:0.0:1788643057.870178:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696856448 00000100:00100000:0.0:1788643057.870197:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696856960 00000100:00100000:0.0:1788643057.870200:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696856960 00000100:00100000:0.0:1788643057.870219:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788643057.870224:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875527696856448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.870255:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875527696856448:12345-0@lo:400:kworker.0 Request processed in 30us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643057.870260:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788643057.870272:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788643057.870277:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875527696856960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.870302:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875527696856960:12345-0@lo:400:kworker.0 Request processed in 25us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643057.870308:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788643057.870322:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788643057.870359:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875527696856448:0@lo:400:kworker.0 00010000:00080000:0.0:1788643057.870369:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc8b31500 x1875527696856960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643057.870377:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875527696856960:0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.870426:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696855808:0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.870435:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696856320:0@lo:400:kworker.0 00000100:00100000:0.0:1788643057.870444:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875527696856832:0@lo:400:kworker.0 00000100:00100000:2.0:1788643057.875907:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696856064:0@lo:400:kworker.0 00000100:00100000:2.0:1788643057.875925:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875527696856576:0@lo:400:kworker.0 00000100:00100000:3.0:1788643057.878979:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696855552 00000100:00100000:3.0:1788643057.878994:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696855552 00000100:00100000:3.0:1788643057.879088:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696857088 00000100:00100000:3.0:1788643057.879093:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696857088 00000100:00100000:3.0:1788643057.879113:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788643057.879121:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696855552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788643057.879151:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788643057.879353:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788643057.879411:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696855552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 289us (11206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643057.879663:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788643057.879683:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788643057.879692:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696857088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788643057.879704:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788643057.879739:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696857088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (10360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643057.879746:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788643057.879860:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696857088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788643057.879895:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696855552:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788643058.571758:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643058.891941:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696857216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788643058.892019:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643058.892117:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696857216 00000100:00100000:1.0:1788643058.892126:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696857216 00000100:00100000:1.0:1788643058.892178:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788643058.892188:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696857216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788643058.892228:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788643058.892274:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696857216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643058.892281:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788643058.892879:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696857216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788643058.893157:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788643058.893168:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacfd420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696857344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788643058.893206:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643058.893862:0:17935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696857344 00000100:00100000:3.0:1788643058.893869:0:17935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696857344 00000100:00100000:3.0:1788643058.893915:0:17935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788643058.893923:0:17935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696857344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788643058.893968:0:17935:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788643058.894032:0:17935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696857344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643058.894039:0:17935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788643058.894123:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacfd420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696857344:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788643059.608159:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788643059.662994:0:17949:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788643060.217665:0:20569:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 17:17:38 (1788643058) 00010000:00010000:2.0:1788643060.621276:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643060.939807:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788643060.939827:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacfd421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696857472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788643060.939887:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643060.939928:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696857472 00000100:00100000:3.0:1788643060.939936:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696857472 00000100:00100000:3.0:1788643060.939989:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788643060.939999:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacfd420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696857472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788643060.940028:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788643060.940075:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacfd420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696857472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643060.940083:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788643060.940126:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacfd421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696857472:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788643060.941225:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788643061.643625:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643062.061754:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643062.061792:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643062.061817:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643062.061843:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675817088 00000100:00100000:0.0:1788643062.061851:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675817088 00000100:00100000:0.0:1788643062.061897:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 166 00000100:00100000:0.0:1788643062.061906:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc74dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:891f2e95-f232-479d-b61c-ed3545b33d67+13:2402:x1875527675817088:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643062.061971:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc74dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:891f2e95-f232-479d-b61c-ed3545b33d67+13:2402:x1875527675817088:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 66us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.061978:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 166 00000100:00100000:0.0:1788643062.062012:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675817344 00000100:00100000:0.0:1788643062.062016:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675817344 00000100:00100000:0.0:1788643062.062049:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675817216 00000100:00100000:0.0:1788643062.062052:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675817216 00000100:00100000:0.0:1788643062.062072:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:0.0:1788643062.062079:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2402:x1875527675817344:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643062.062108:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2402:x1875527675817344:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.062115:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 65 00000100:00100000:0.0:1788643062.062128:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00100000:0.0:1788643062.062134:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+13:2402:x1875527675817216:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643062.062173:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+13:2402:x1875527675817216:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 39us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.062181:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 66 00000100:00080000:0.0:1788643062.062351:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788643062.062356:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788643062.079085:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643062.079184:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675817472 00000100:00100000:0.0:1788643062.079193:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675817472 00000100:00100000:0.0:1788643062.079260:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:0.0:1788643062.079272:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2398:x1875527675817472:12345-192.168.206.18@tcp:9:kworker.0 00000020:00000080:0.0:1788643062.079299:0:18701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c38e7 00000100:00080000:0.0:1788643062.079326:0:18701:0:(import.c:65:import_set_state_nolock()) ffff9cacfcf50000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788643062.079369:0:18701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788643062.079542:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+2:2398:x1875527675817472:12345-192.168.206.18@tcp:9:kworker.0 Request processed in 273us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.079550:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00080000:1.0:1788643062.079742:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788643062.079889:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643062.093066:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643062.093108:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643062.093139:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643062.093160:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643062.093179:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643062.093203:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675817728 00000100:00100000:0.0:1788643062.093212:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675817728 00000100:00100000:0.0:1788643062.093266:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675817856 00000100:00100000:0.0:1788643062.093269:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675817856 00000100:00100000:0.0:1788643062.093320:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:0.0:1788643062.093330:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+6:2399:x1875527675817728:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643062.093643:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+6:2399:x1875527675817728:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 314us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.093659:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:0.0:1788643062.093680:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:0.0:1788643062.093686:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2399:x1875527675817856:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643062.093726:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2399:x1875527675817856:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 28us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.093734:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:0.0:1788643062.093752:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675817600 00000100:00100000:0.0:1788643062.093756:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675817600 00000100:00100000:0.0:1788643062.093779:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675817984 00000100:00100000:0.0:1788643062.093782:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675817984 00000100:00100000:0.0:1788643062.093794:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675818112 00000100:00100000:0.0:1788643062.093796:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675818112 00000100:00100000:0.0:1788643062.093809:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:0.0:1788643062.093814:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2399:x1875527675817600:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643062.093839:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2399:x1875527675817600:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 25us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.093845:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:0.0:1788643062.093857:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:0.0:1788643062.093863:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2398:x1875527675817984:12345-192.168.206.18@tcp:9:kworker.0 00000020:00000080:0.0:1788643062.093880:0:19890:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3926 00000100:00080000:0.0:1788643062.093889:0:19890:0:(import.c:65:import_set_state_nolock()) ffff9cabc7db2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788643062.093931:0:19890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788643062.094026:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+2:2398:x1875527675817984:12345-192.168.206.18@tcp:9:kworker.0 Request processed in 162us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.094033:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:0.0:1788643062.094053:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:0.0:1788643062.094059:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2398:x1875527675818112:12345-192.168.206.18@tcp:9:kworker.0 00000020:00000080:0.0:1788643062.094070:0:19890:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c392d 00000100:00080000:0.0:1788643062.094077:0:19890:0:(import.c:65:import_set_state_nolock()) ffff9cacc8c40800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788643062.094097:0:19890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788643062.094174:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+2:2398:x1875527675818112:12345-192.168.206.18@tcp:9:kworker.0 Request processed in 114us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.094180:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 32 00010000:00010000:0.0:1788643062.094243:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788643062.094250:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788643062.094254:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788643062.094256:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788643062.094258:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788643062.094744:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788643062.477426:0:17173:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:0.0:1788643062.477590:0:17234:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:0.0:1788643062.477603:0:17234:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:3.0:1788643062.667815:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643062.988682:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc899d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696857728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788643062.988757:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643062.988907:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788643062.988918:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696857600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788643062.988948:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643062.989592:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696857728 00000100:00100000:0.0:1788643062.989599:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696857728 00000100:00100000:0.0:1788643062.989642:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696857600 00000100:00100000:0.0:1788643062.989645:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696857600 00000100:00100000:0.0:1788643062.989661:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788643062.989668:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696857728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788643062.989693:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788643062.989734:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696857728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.989741:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788643062.989770:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788643062.989776:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696857600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788643062.989786:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788643062.989811:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696857600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.989817:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788643062.989832:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788643062.989844:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696857984:0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.989871:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643062.989896:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696858496:0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.989919:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643062.989935:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875527696859008:0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.989957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643062.989992:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696857600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788643062.990014:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788643062.990020:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696858112:0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.990043:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643062.990064:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875527696858624:0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.990092:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643062.990110:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875527696859136:0@lo:400:kworker.0 00000100:00100000:1.0:1788643062.990119:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696858496 00000100:00100000:1.0:1788643062.990125:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696858496 00000100:00100000:0.0:1788643062.990134:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643062.990165:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696859008 00000100:00100000:0.0:1788643062.990170:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696859008 00000100:00100000:1.0:1788643062.990171:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696858112 00000100:00100000:1.0:1788643062.990177:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696858112 00000100:00100000:0.0:1788643062.990202:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696858624 00000100:00100000:0.0:1788643062.990207:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696858624 00000100:00100000:1.0:1788643062.990210:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788643062.990219:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696858496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.990236:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696859136 00000100:00100000:0.0:1788643062.990241:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696859136 00000100:00100000:0.0:1788643062.990261:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788643062.990268:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875527696859008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643062.990284:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696858496:12345-0@lo:400:kworker.0 Request processed in 66us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643062.990291:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788643062.990318:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788643062.990324:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875527696859008:12345-0@lo:400:kworker.0 Request processed in 54us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643062.990331:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696858112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.990337:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788643062.990368:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696858112:12345-0@lo:400:kworker.0 Request processed in 41us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643062.990374:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788643062.990530:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788643062.990539:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875527696858624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643062.990541:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696857984 00000100:00100000:1.0:1788643062.990547:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696857984 00000100:00100000:0.0:1788643062.990573:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875527696858624:12345-0@lo:400:kworker.0 Request processed in 36us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643062.990578:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788643062.990584:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788643062.990591:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696857984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.990600:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788643062.990608:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875527696859136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643062.990640:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696857984:12345-0@lo:400:kworker.0 Request processed in 51us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.990648:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875527696859136:12345-0@lo:400:kworker.0 Request processed in 40us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643062.990654:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788643062.990692:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788643062.990695:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788643062.990697:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788643062.990718:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696858112:0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.990726:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875527696858624:0@lo:400:kworker.0 00010000:00080000:0.0:1788643062.990737:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacf7f05f80 x1875527696859136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643062.990747:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875527696859136:0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.990765:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696857984:0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.990773:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696858496:0@lo:400:kworker.0 00000100:00100000:0.0:1788643062.990781:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875527696859008:0@lo:400:kworker.0 00000100:00100000:1.0:1788643062.991356:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788643062.992371:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01073fa7-a753-425c-8af1-85d79a3a8f8c:3645:1875527696857856:0@lo:400:kworker.0 00000100:00100000:2.0:1788643062.992468:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643062.992513:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696858368:0@lo:400:kworker.0 00000100:00100000:2.0:1788643062.992535:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643062.992549:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875527696858880:0@lo:400:kworker.0 00000100:00100000:2.0:1788643062.992570:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643062.992590:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788643062.992595:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875527696858240:0@lo:400:kworker.0 00000100:00100000:2.0:1788643062.992614:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643062.992628:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875527696858752:0@lo:400:kworker.0 00000100:00100000:2.0:1788643062.992644:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643062.992658:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696859264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788643062.992676:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643062.992701:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696858880 00000100:00100000:2.0:1788643062.992707:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696858880 00000100:00100000:2.0:1788643062.992767:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696858240 00000100:00100000:2.0:1788643062.992770:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696858240 00000100:00100000:2.0:1788643062.992780:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696858752 00000100:00100000:2.0:1788643062.992782:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696858752 00000100:00100000:2.0:1788643062.992796:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788643062.992802:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875527696858880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643062.992844:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875527696858880:12345-0@lo:400:kworker.0 Request processed in 43us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643062.992850:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788643062.992863:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788643062.992868:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875527696858240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643062.992889:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875527696858240:12345-0@lo:400:kworker.0 Request processed in 21us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643062.992894:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788643062.992904:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788643062.992909:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875527696858752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643062.992929:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875527696858752:12345-0@lo:400:kworker.0 Request processed in 21us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643062.992934:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788643062.992952:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788643062.992955:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788643062.992983:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc899d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696857728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788643062.993003:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696859264 00000100:00100000:2.0:1788643062.993006:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696859264 00000100:00100000:2.0:1788643062.993024:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788643062.993030:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696859264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788643062.993047:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788643062.993077:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696858368 00000100:00100000:1.0:1788643062.993083:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696858368 00000100:00100000:2.0:1788643062.993088:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696859264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643062.993095:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788643062.993113:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788643062.993122:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696858368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643062.993139:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875527696858240:0@lo:400:kworker.0 00000100:00100000:2.0:1788643062.993153:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875527696858752:0@lo:400:kworker.0 00000100:00100000:1.0:1788643062.993169:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696858368:12345-0@lo:400:kworker.0 Request processed in 47us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643062.993176:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696859264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788643062.993178:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788643062.993197:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696858368:0@lo:400:kworker.0 00010000:00080000:2.0:1788643062.993212:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacf7f05180 x1875527696858880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643062.993222:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875527696858880:0@lo:400:kworker.0 00000100:00100000:3.0:1788643062.993425:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696857856 00000100:00100000:3.0:1788643062.993430:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696857856 00000100:00100000:3.0:1788643062.993469:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788643062.993477:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc74dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01073fa7-a753-425c-8af1-85d79a3a8f8c+24:3645:x1875527696857856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643062.993527:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc74dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01073fa7-a753-425c-8af1-85d79a3a8f8c+24:3645:x1875527696857856:12345-0@lo:400:kworker.0 Request processed in 51us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643062.993533:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788643062.996158:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01073fa7-a753-425c-8af1-85d79a3a8f8c:3645:1875527696857856:0@lo:400:kworker.0 00010000:00010000:0.0:1788643063.692268:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643063.978319:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643063.978417:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675818368 00000100:00100000:2.0:1788643063.978427:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675818368 00000100:00100000:2.0:1788643063.978491:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:2.0:1788643063.978501:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+13:16363:x1875527675818368:12345-192.168.206.18@tcp:35:umount.0 00000001:00080000:2.0:1788643063.978783:0:17197:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:2.0:1788643063.978921:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+15:16363:x1875527675818368:12345-192.168.206.18@tcp:35:umount.0 Request processed in 420us (611us total) trans 8589934625 rc 0/0 00000100:00100000:2.0:1788643063.978929:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00000020:00080000:2.0:1788643063.978933:0:17197:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788643063.983327:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643063.983376:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643063.983535:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675818496 00000100:00100000:1.0:1788643063.983545:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675818496 00000100:00100000:1.0:1788643063.983609:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675818624 00000100:00100000:1.0:1788643063.983612:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675818624 00000100:00100000:1.0:1788643063.983629:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:1.0:1788643063.983637:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+14:2401:x1875527675818496:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788643063.983650:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643063.983667:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacf6d3c000/0x119ccc6e683c38c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c6b6 expref: 14 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643063.983685:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643063.983741:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+13:2401:x1875527675818496:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 104us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643063.983748:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:1.0:1788643063.983766:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:1.0:1788643063.983772:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacfe9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+12:2401:x1875527675818624:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788643063.983780:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643063.983790:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacc2811600/0x119ccc6e683c38cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c6e7 expref: 12 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643063.983811:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643063.983830:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacfe9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+11:2401:x1875527675818624:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 59us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643063.983837:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:0.0:1788643063.992721:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643063.992767:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643063.992851:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675818752 00000100:00100000:1.0:1788643063.992859:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675818752 00000100:00100000:1.0:1788643063.992931:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:1.0:1788643063.992941:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9999880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+11:2402:x1875527675818752:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788643063.992956:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643063.992986:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacfe7aaa00/0x119ccc6e683c3988 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c79d expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643063.993002:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643063.993060:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9999880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+10:2402:x1875527675818752:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 120us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643063.993067:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:2.0:1788643063.993139:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675818880 00000100:00100000:2.0:1788643063.993143:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675818880 00000100:00100000:2.0:1788643063.993180:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:2.0:1788643063.993188:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2398:x1875527675818880:12345-192.168.206.18@tcp:9:umount.0 00000020:00000080:2.0:1788643063.993228:0:19890:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c38ee 00000100:00080000:2.0:1788643063.993237:0:19890:0:(import.c:65:import_set_state_nolock()) ffff9cacfcf56800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788643063.993278:0:19890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788643063.993423:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+2:2398:x1875527675818880:12345-192.168.206.18@tcp:9:umount.0 Request processed in 235us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643063.993430:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 33 00010000:00010000:3.0:1788643063.993685:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643064.005958:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643064.006240:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675819776 00000100:00100000:2.0:1788643064.006249:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675819776 00000100:00100000:2.0:1788643064.006328:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 67 00000100:00100000:2.0:1788643064.006338:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+15:2398:x1875527675819776:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:2.0:1788643064.006366:0:17194:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c38d9 00000020:00010000:2.0:1788643064.006400:0:17194:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cabc7987800: total 0 00000100:00080000:2.0:1788643064.006405:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9cabc1c87800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788643064.006426:0:17194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:2.0:1788643064.006553:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+14:2398:x1875527675819776:12345-192.168.206.18@tcp:39:umount.0 Request processed in 217us (602us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1788643064.006560:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 67 00000020:00010000:1.0:1788643064.006798:0:17950:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cabc7987800: total 0 00010000:00010000:1.0:1788643064.006803:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643064.006854:0:17950:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cabc7987800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788643064.006899:0:17950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cacfda88400) 00010000:00010000:1.0:1788643064.006903:0:17950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788643064.006911:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc2811c00/0x119ccc6e683c3b33 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c822 expref: 13 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643064.006930:0:17950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cacf0655d00) 00010000:00010000:1.0:1788643064.006932:0:17950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788643064.006949:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc2810c00/0x119ccc6e683c39a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c7a4 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643064.006982:0:17950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cacd1153300) 00010000:00010000:1.0:1788643064.006985:0:17950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788643064.006989:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ce00/0x119ccc6e683c3a84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c7e3 expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643064.007005:0:17950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cacfda88400) 00010000:00010000:1.0:1788643064.007008:0:17950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788643064.007011:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc0030a00/0x119ccc6e683c3b02 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c80d expref: 10 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643064.007240:0:17950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cacfda88400) 00010000:00010000:1.0:1788643064.007243:0:17950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788643064.007248:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c3bf0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c85a expref: 9 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643064.007262:0:17950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cacd1153800) 00010000:00010000:1.0:1788643064.007264:0:17950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788643064.007267:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c39c0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c7ab expref: 8 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643064.007280:0:17950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cabc6b23600) 00010000:00010000:1.0:1788643064.007282:0:17950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788643064.007285:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc0030c00/0x119ccc6e683c39ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c7b9 expref: 7 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643064.007308:0:17950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cacf0655600) 00010000:00010000:1.0:1788643064.007317:0:17950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788643064.007322:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494000/0x119ccc6e683c3b8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c837 expref: 6 pid: 20193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643064.007335:0:17950:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cabc7987800, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1788643064.007349:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643064.007351:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643064.007353:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788643064.008542:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788643064.011836:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacfd421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696859392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788643064.011912:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643064.011991:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696859392 00000100:00100000:1.0:1788643064.011999:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696859392 00000100:00100000:1.0:1788643064.012056:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788643064.012065:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696859392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788643064.012096:0:17198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788643064.012151:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696859392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643064.012158:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788643064.012307:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacfd421500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696859392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788643064.013184:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788643064.013197:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696859520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788643064.013239:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643064.013760:0:17935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696859520 00000100:00100000:1.0:1788643064.013767:0:17935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696859520 00000100:00100000:1.0:1788643064.013810:0:17935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788643064.013817:0:17935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacfd421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696859520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788643064.013844:0:17935:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788643064.013955:0:17935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacfd421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696859520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643064.013963:0:17935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788643064.014252:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696859520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788643064.015791:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643064.017162:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675819904 00000100:00100000:1.0:1788643064.017174:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675819904 00000100:00100000:1.0:1788643064.017242:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 68 00000100:00100000:1.0:1788643064.017253:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+5:2398:x1875527675819904:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:1.0:1788643064.017303:0:20193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c38e0 00000100:00080000:1.0:1788643064.017319:0:20193:0:(import.c:65:import_set_state_nolock()) ffff9cabc1c84800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788643064.017351:0:20193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788643064.017569:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf4bba2-7433-41d2-8c45-307c35e3cbbe+3:2398:x1875527675819904:12345-192.168.206.18@tcp:39:umount.0 Request processed in 318us (1782us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788643064.017590:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 68 00010000:00010000:2.0:1788643064.017675:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788643064.017740:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788643064.716763:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643065.405530:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643065.405568:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643065.405651:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675820032 00000100:00100000:1.0:1788643065.405660:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675820032 00000100:00100000:1.0:1788643065.405715:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675820160 00000100:00100000:1.0:1788643065.405719:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675820160 00000100:00100000:1.0:1788643065.405738:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:1.0:1788643065.405747:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+11:2402:x1875527675820032:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788643065.405761:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643065.405779:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacc0031a00/0x119ccc6e683c3903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c726 expref: 11 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643065.405796:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643065.405851:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+10:2402:x1875527675820032:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643065.405858:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:1.0:1788643065.405876:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:1.0:1788643065.405882:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+9:2401:x1875527675820160:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788643065.405890:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643065.405898:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacf6d3c200/0x119ccc6e683c390a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c757 expref: 9 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643065.405907:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643065.405938:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+8:2401:x1875527675820160:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 56us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643065.405945:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:0.0:1788643065.407250:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643065.407325:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675820288 00000100:00100000:1.0:1788643065.407333:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675820288 00000100:00100000:1.0:1788643065.407402:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:1.0:1788643065.407411:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+8:2402:x1875527675820288:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788643065.407423:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643065.407438:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3981 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c796 expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643065.407450:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643065.407490:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9999180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:891f2e95-f232-479d-b61c-ed3545b33d67+7:2402:x1875527675820288:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643065.407497:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:0.0:1788643065.415527:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643065.415623:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675820544 00000100:00100000:2.0:1788643065.415632:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675820544 00000100:00100000:2.0:1788643065.415701:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 69 00000100:00100000:2.0:1788643065.415712:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371cd762-ea78-4bcd-8c54-d51e9137aa0d+6:2398:x1875527675820544:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:2.0:1788643065.415749:0:17194:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3918 00000020:00010000:2.0:1788643065.415756:0:17194:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cace70d4000: total 0 00000100:00080000:2.0:1788643065.415771:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9cace70d1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788643065.415796:0:17194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1788643065.415925:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2398:x1875527675820544:12345-192.168.206.18@tcp:39:umount.0 Request processed in 214us (404us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1788643065.415932:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 69 00000100:00080000:0.0:1788643065.416164:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1788643065.416604:0:17950:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cace70d4000: total 0 00010000:00010000:1.0:1788643065.416667:0:17950:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cace70d4000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788643065.416702:0:17950:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cabc6b23600) 00010000:00010000:1.0:1788643065.416706:0:17950:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788643065.416715:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacc2810600/0x119ccc6e683c3a0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c7c0 expref: 4 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643065.416737:0:17950:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cace70d4000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788643065.416750:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643065.416752:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643065.416753:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643065.423470:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643065.423576:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675820672 00000100:00100000:1.0:1788643065.423585:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675820672 00000100:00100000:1.0:1788643065.423655:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 70 00000100:00100000:1.0:1788643065.423665:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+5:2398:x1875527675820672:12345-192.168.206.18@tcp:39:umount.0 00000020:00000080:1.0:1788643065.423701:0:20193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c391f 00000100:00080000:1.0:1788643065.423712:0:20193:0:(import.c:65:import_set_state_nolock()) ffff9cace70d2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788643065.423738:0:20193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788643065.423866:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371cd762-ea78-4bcd-8c54-d51e9137aa0d+3:2398:x1875527675820672:12345-192.168.206.18@tcp:39:umount.0 Request processed in 201us (403us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788643065.423874:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 70 00010000:00010000:2.0:1788643065.423962:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788643065.424247:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788643065.460807:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643065.460916:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675820928 00000100:00100000:0.0:1788643065.460925:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675820928 00000100:00100000:0.0:1788643065.460983:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 168 00000100:00100000:0.0:1788643065.460993:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc74dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:891f2e95-f232-479d-b61c-ed3545b33d67+7:2398:x1875527675820928:12345-192.168.206.18@tcp:251:umount.0 00000020:00000080:0.0:1788643065.461032:0:17188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c38b6 00000020:00010000:0.0:1788643065.461039:0:17188:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cabc10e2000: total 0 00000100:00080000:0.0:1788643065.461055:0:17188:0:(import.c:65:import_set_state_nolock()) ffff9cabc10e6800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788643065.461128:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc74dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:891f2e95-f232-479d-b61c-ed3545b33d67+3:2398:x1875527675820928:12345-192.168.206.18@tcp:251:umount.0 Request processed in 136us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643065.461137:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 168 00000020:00010000:3.0:1788643065.461373:0:17181:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cabc10e2000: total 0 00010000:00010000:3.0:1788643065.461459:0:17181:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cabc10e2000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788643065.461491:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacfe7ab200/0x119ccc6e683c38bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c6af expref: 2 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643065.461504:0:17181:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cabc10e2000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788643065.461515:0:17181:0:(genops.c:885:class_export_put()) final put ffff9cabc10e2000/891f2e95-f232-479d-b61c-ed3545b33d67 00010000:00010000:3.0:1788643065.461533:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643065.461535:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643065.461537:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788643065.461577:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc10e2000/891f2e95-f232-479d-b61c-ed3545b33d67 for MGS 00000020:00000080:2.0:1788643065.461604:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc10e6800 for MGS 00010000:00010000:0.0:1788643065.739861:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643066.061055:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696859648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788643066.061129:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643066.061177:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696859648 00000100:00100000:3.0:1788643066.061185:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696859648 00000100:00100000:3.0:1788643066.061231:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788643066.061253:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacfd423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696859648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788643066.061300:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788643066.061352:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacfd423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696859648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643066.061359:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788643066.061409:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788643066.061442:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696859648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788643066.763665:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788643067.148106:0:20764:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788643067.164901:0:20764:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788643067.164972:0:20764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02174600/0x119ccc6e683c3479 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3480 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.164987:0:20764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02174600/0x119ccc6e683c3479 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3480 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.164995:0:20764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02174600/0x119ccc6e683c3479 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3480 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.165003:0:20764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cad02174600/0x119ccc6e683c3479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3480 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.165028:0:20764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788643067.165034:0:20764:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788643067.165060:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788643067.165065:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788643067.165070:0:20764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788643067.165093:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9cacf5763000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788643067.165146:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875527696859776:0@lo:39:umount.0 00000100:00100000:1.0:1788643067.165211:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643067.165308:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696859776 00000100:00100000:2.0:1788643067.165316:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696859776 00000100:00100000:2.0:1788643067.165360:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788643067.165369:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875527696859776:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788643067.165412:0:17194:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c34aa 00000100:00080000:2.0:1788643067.165419:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9cacf5761800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788643067.165541:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643067.165549:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cad02174600/0x119ccc6e683c3479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3480 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.165556:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cad02174600 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643067.165560:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cad02174600/0x119ccc6e683c3479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3480 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.165571:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cad02174600/0x119ccc6e683c3479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c3480 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643067.165579:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cad02174600/0x119ccc6e683c3479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c3480 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643067.165585:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788643067.165587:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788643067.165589:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788643067.165614:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cad02174600/0x119ccc6e683c3479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c3480 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.165619:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788643067.165655:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cad02174600/0x119ccc6e683c3479 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c3480 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.165662:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cad02174600/0x119ccc6e683c3479 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c3480 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.165690:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643067.165691:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643067.165693:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643067.165700:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643067.165707:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788643067.165718:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01073fa7-a753-425c-8af1-85d79a3a8f8c:3645:1875527696859904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643067.165750:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643067.165783:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696859904 00000100:00100000:0.0:1788643067.165787:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696859904 00000100:00100000:0.0:1788643067.165823:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788643067.165830:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01073fa7-a753-425c-8af1-85d79a3a8f8c+24:3645:x1875527696859904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788643067.165841:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788643067.165854:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cabc7495e00/0x119ccc6e683c3480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c3479 expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.165866:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788643067.165894:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01073fa7-a753-425c-8af1-85d79a3a8f8c+23:3645:x1875527696859904:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643067.165900:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788643067.165937:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01073fa7-a753-425c-8af1-85d79a3a8f8c:3645:1875527696859904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788643067.172156:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3641:x1875527696859776:12345-0@lo:39:umount.0 Request processed in 6778us (6935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643067.172170:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1788643067.172185:0:17194:0:(genops.c:885:class_export_put()) final put ffff9cacf5765000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788643067.172273:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacf5765000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788643067.172343:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacf5761800 for lustre-MDT0000 00000100:00080000:0.0:1788643067.172949:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacf5763000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788643067.173301:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875527696859776:0@lo:39:umount.0 00000100:00080000:3.0:1788643067.173367:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788643067.173372:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788643067.173376:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788643067.174228:0:20764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab200/0x119ccc6e683c33ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c33d1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174258:0:20764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab200/0x119ccc6e683c33ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c33d1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174266:0:20764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab200/0x119ccc6e683c33ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c33d1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174273:0:20764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab200/0x119ccc6e683c33ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c33d1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174305:0:20764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788643067.174311:0:20764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab800/0x119ccc6e683c37dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c37e4 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174318:0:20764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab800/0x119ccc6e683c37dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c37e4 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174325:0:20764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab800/0x119ccc6e683c37dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c37e4 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174331:0:20764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab800/0x119ccc6e683c37dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c37e4 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174344:0:20764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788643067.174350:0:20764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab400/0x119ccc6e683c3973 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c397a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174360:0:20764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab400/0x119ccc6e683c3973 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c397a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174376:0:20764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab400/0x119ccc6e683c3973 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c397a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174416:0:20764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab400/0x119ccc6e683c3973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c397a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174431:0:20764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788643067.174436:0:20764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02174c00/0x119ccc6e683c33bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c33c3 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174442:0:20764:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02174c00/0x119ccc6e683c33bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c33c3 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174448:0:20764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02174c00/0x119ccc6e683c33bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c33c3 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174455:0:20764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cad02174c00/0x119ccc6e683c33bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c33c3 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643067.174462:0:20764:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788643067.174464:0:20764:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788643067.174490:0:20764:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788643067.174493:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788643067.174497:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643067.174501:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788643067.174506:0:20764:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cace70d3000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788643067.174510:0:20764:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cabc7ce5800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788643067.174514:0:20764:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cabc7f30800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788643067.174524:0:20764:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cabc76bb000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788643067.174529:0:20764:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9cace70d4000 371cd762-ea78-4bcd-8c54-d51e9137aa0d 192.168.206.18@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1788643067.174534:0:20764:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9cabc7987800 cbf4bba2-7433-41d2-8c45-307c35e3cbbe 192.168.206.18@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1788643067.174538:0:20764:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9cabc7923380) has exports, disconnecting them 00000020:00080000:3.0:1788643067.174542:0:20764:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cace70d3000), last request at 1788643062 00000020:00000080:3.0:1788643067.174548:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c37ac 00000100:00080000:3.0:1788643067.174564:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9cace70d5800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788643067.174607:0:20764:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cace70d3000): rc 0 00000020:00000080:3.0:1788643067.174609:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cace70d3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788643067.174617:0:20764:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cabc7ce5800), last request at 1788643062 00000020:00000080:3.0:1788643067.174620:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3647 00000100:00080000:3.0:1788643067.174625:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9cabc7ce0000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788643067.174631:0:20764:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cabc7ce5800): rc 0 00000020:00000080:3.0:1788643067.174632:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cabc7ce5800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788643067.174635:0:20764:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cabc7f30800), last request at 1788643007 00000020:00000080:3.0:1788643067.174637:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3598 00000100:00080000:3.0:1788643067.174640:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9cabc7f37800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788643067.174644:0:20764:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cabc7f30800): rc 0 00000020:00000080:3.0:1788643067.174646:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cabc7f30800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788643067.174649:0:20764:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cabc76bb000), last request at 1788643007 00000020:00000080:3.0:1788643067.174651:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c353d 00000100:00080000:3.0:1788643067.174654:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9cacd0e15000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788643067.174659:0:20764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00080000:3.0:1788643067.174725:0:20764:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cabc76bb000): rc 0 00000004:00000080:3.0:1788643067.174731:0:20764:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa83bc1c7fae0 00000100:00080000:3.0:1788643067.174745:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788643067.174753:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788643067.175550:0:20764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788643067.175573:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9cacfd794800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788643067.175738:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788643067.175746:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab200/0x119ccc6e683c33ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c33d1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175767:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc13ab200 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643067.175770:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab200/0x119ccc6e683c33ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c33d1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175778:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab200/0x119ccc6e683c33ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c33d1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643067.175785:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab200/0x119ccc6e683c33ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c33d1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643067.175790:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788643067.175792:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788643067.175795:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788643067.175821:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab200/0x119ccc6e683c33ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c33d1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175828:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788643067.175846:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab200/0x119ccc6e683c33ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c33d1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175852:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab200/0x119ccc6e683c33ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c33d1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175863:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788643067.175867:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab800/0x119ccc6e683c37dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c37e4 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175872:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab800 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643067.175875:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab800/0x119ccc6e683c37dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c37e4 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175888:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab800/0x119ccc6e683c37dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c37e4 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643067.175893:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab800/0x119ccc6e683c37dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c37e4 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643067.175900:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788643067.175902:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788643067.175904:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788643067.175919:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab800/0x119ccc6e683c37dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c37e4 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175924:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788643067.175938:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab800/0x119ccc6e683c37dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c37e4 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175944:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab800/0x119ccc6e683c37dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c37e4 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175953:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788643067.175957:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab400/0x119ccc6e683c3973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c397a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175962:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab400 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643067.175965:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab400/0x119ccc6e683c3973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c397a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.175971:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab400/0x119ccc6e683c3973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c397a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643067.175987:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab400/0x119ccc6e683c3973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c397a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643067.175993:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788643067.175995:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788643067.175997:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788643067.176010:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab400/0x119ccc6e683c3973 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c397a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176016:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788643067.176022:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab400/0x119ccc6e683c3973 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c397a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176029:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab400/0x119ccc6e683c3973 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c397a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176038:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643067.176041:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cad02174c00/0x119ccc6e683c33bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c33c3 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176048:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cad02174c00 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643067.176050:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cad02174c00/0x119ccc6e683c33bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c33c3 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176056:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cad02174c00/0x119ccc6e683c33bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c33c3 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643067.176062:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cad02174c00/0x119ccc6e683c33bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c33c3 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643067.176077:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788643067.176079:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788643067.176081:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788643067.176095:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cad02174c00/0x119ccc6e683c33bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c33c3 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176100:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788643067.176106:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cad02174c00/0x119ccc6e683c33bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c33c3 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176112:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cad02174c00/0x119ccc6e683c33bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c33c3 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176121:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643067.176123:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643067.176125:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643067.176138:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01073fa7-a753-425c-8af1-85d79a3a8f8c:3644:1875527696860544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643067.176206:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643067.176252:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788643067.176258:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01073fa7-a753-425c-8af1-85d79a3a8f8c:3644:1875527696860160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643067.176295:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643067.176319:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01073fa7-a753-425c-8af1-85d79a3a8f8c:3642:1875527696860288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643067.176340:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643067.176355:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788643067.176360:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01073fa7-a753-425c-8af1-85d79a3a8f8c:3642:1875527696860416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643067.176404:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643067.176430:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696860544 00000100:00100000:0.0:1788643067.176443:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696860544 00000100:00100000:0.0:1788643067.176478:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696860160 00000100:00100000:0.0:1788643067.176481:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696860160 00000100:00100000:0.0:1788643067.176493:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696860288 00000100:00100000:0.0:1788643067.176495:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696860288 00000100:00100000:0.0:1788643067.176506:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696860416 00000100:00100000:0.0:1788643067.176509:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696860416 00000100:00100000:0.0:1788643067.176524:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788643067.176531:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01073fa7-a753-425c-8af1-85d79a3a8f8c+26:3644:x1875527696860544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788643067.176543:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788643067.176556:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cabc7495c00/0x119ccc6e683c33c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c33bc expref: 26 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176568:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788643067.176603:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01073fa7-a753-425c-8af1-85d79a3a8f8c+25:3644:x1875527696860544:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643067.176610:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788643067.176626:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788643067.176632:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacfe9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01073fa7-a753-425c-8af1-85d79a3a8f8c+24:3644:x1875527696860160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788643067.176639:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788643067.176648:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cabc7495200/0x119ccc6e683c33d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c33ca expref: 24 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176656:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788643067.176675:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacfe9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01073fa7-a753-425c-8af1-85d79a3a8f8c+23:3644:x1875527696860160:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643067.176681:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788643067.176712:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788643067.176719:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01073fa7-a753-425c-8af1-85d79a3a8f8c+22:3642:x1875527696860288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788643067.176733:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788643067.176742:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cabc7495000/0x119ccc6e683c37e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c37dd expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176750:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788643067.176776:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01073fa7-a753-425c-8af1-85d79a3a8f8c+21:3642:x1875527696860288:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643067.176782:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788643067.176796:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788643067.176802:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01073fa7-a753-425c-8af1-85d79a3a8f8c+20:3642:x1875527696860416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788643067.176809:0:17178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788643067.176817:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacf6d3c400/0x119ccc6e683c397a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c3973 expref: 20 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643067.176825:0:17178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788643067.176845:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01073fa7-a753-425c-8af1-85d79a3a8f8c+19:3642:x1875527696860416:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643067.176850:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788643067.176883:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01073fa7-a753-425c-8af1-85d79a3a8f8c:3642:1875527696860416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643067.176892:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01073fa7-a753-425c-8af1-85d79a3a8f8c:3642:1875527696860288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643067.176922:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01073fa7-a753-425c-8af1-85d79a3a8f8c:3644:1875527696860160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643067.176929:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01073fa7-a753-425c-8af1-85d79a3a8f8c:3644:1875527696860544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643067.176943:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacfd422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696860032:0@lo:39:umount.0 00000100:00100000:0.0:1788643067.176969:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643067.177009:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696860032 00000100:00100000:0.0:1788643067.177014:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696860032 00000100:00100000:0.0:1788643067.177041:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788643067.177046:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875527696860032:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788643067.177067:0:17199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c35c2 00000100:00080000:0.0:1788643067.177074:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9cabc7f31800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788643067.177092:0:17199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788643067.177203:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3641:x1875527696860032:12345-0@lo:39:umount.0 Request processed in 157us (233us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788643067.177210:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:0.0:1788643067.177228:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788643067.177243:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacfd794800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788643067.177250:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacfd422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696860032:0@lo:39:umount.0 00010000:00010000:2.0:1788643067.177331:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788643067.177342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cace70d3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788643067.177415:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7ce5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788643067.177443:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7f30800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788643067.177510:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cace70d5800 for lustre-MDT0000 00000020:00000080:2.0:1788643067.177515:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc7ce0000 for lustre-MDT0000 00000020:00000080:2.0:1788643067.177518:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc7f37800 for lustre-MDT0000 00010000:00010000:1.0:1788643067.177748:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788643067.180193:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788643067.180202:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788643067.180275:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788643067.180345:0:20764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788643067.180372:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9cabc5da4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788643067.180496:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696860672:0@lo:9:umount.0 00000100:00100000:2.0:1788643067.180565:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788643067.180620:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788643067.180623:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1788643067.180632:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788643067.180688:0:20764:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788643067.180698:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9cacfe599000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788643067.180759:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696860672 00000100:00100000:0.0:1788643067.180766:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696860672 00000100:00100000:0.0:1788643067.180819:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788643067.180828:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875527696860672:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788643067.180851:0:18701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c366a 00000100:00080000:0.0:1788643067.180859:0:18701:0:(import.c:65:import_set_state_nolock()) ffff9cacfe793000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788643067.180894:0:18701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788643067.182127:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc5dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696860800:0@lo:9:umount.0 00000100:00100000:2.0:1788643067.182174:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643067.182288:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696860800 00000100:00100000:1.0:1788643067.182295:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696860800 00000100:00100000:1.0:1788643067.182339:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788643067.182348:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875527696860800:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788643067.182367:0:19890:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c37eb 00000100:00080000:1.0:1788643067.182374:0:19890:0:(import.c:65:import_set_state_nolock()) ffff9cabc7982000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788643067.182431:0:19890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788643067.182539:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3641:x1875527696860800:12345-0@lo:9:umount.0 Request processed in 192us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643067.182547:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788643067.182566:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1788643067.183121:0:20764:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9cabc7923380) has no exports 00010000:00010000:1.0:1788643067.185021:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643067.185681:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3641:x1875527696860672:12345-0@lo:9:umount.0 Request processed in 4849us (5109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643067.185692:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000001:00100000:3.0:1788643067.186312:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788643067.186317:0:19514:0:(genops.c:885:class_export_put()) final put ffff9cabc7985000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788643067.186338:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cbf4bba2-7433-41d2-8c45-307c35e3cbbe 00000020:00000080:3.0:1788643067.186341:0:19514:0:(genops.c:885:class_export_put()) final put ffff9cacfcf56000/cbf4bba2-7433-41d2-8c45-307c35e3cbbe 00000001:00100000:3.0:1788643067.186347:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 371cd762-ea78-4bcd-8c54-d51e9137aa0d 00000020:00000080:3.0:1788643067.186350:0:19514:0:(genops.c:885:class_export_put()) final put ffff9cacc8c41000/371cd762-ea78-4bcd-8c54-d51e9137aa0d 00000020:00000080:0.0:1788643067.186458:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7985000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788643067.186511:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfcf56000/cbf4bba2-7433-41d2-8c45-307c35e3cbbe for lustre-OST0001 00000020:00000080:0.0:1788643067.186527:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacc8c41000/371cd762-ea78-4bcd-8c54-d51e9137aa0d for lustre-OST0001 00000020:00000080:0.0:1788643067.186544:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc7982000 for lustre-OST0001 00000020:00000080:0.0:1788643067.186556:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacfcf56800 for lustre-OST0001 00000020:00000080:0.0:1788643067.186559:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacc8c40800 for lustre-OST0001 00000100:00080000:2.0:1788643067.189914:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc5da4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788643067.189935:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788643067.189937:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788643067.189943:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696860672:0@lo:9:umount.0 00000100:00080000:2.0:1788643067.189978:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacfe599000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788643067.189988:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788643067.189990:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788643067.189993:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc5dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696860800:0@lo:9:umount.0 00010000:00010000:2.0:1788643067.190011:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788643067.191371:0:18698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788643067.191406:0:18698:0:(genops.c:885:class_export_put()) final put ffff9cacfe794800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788643067.191433:0:18698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 371cd762-ea78-4bcd-8c54-d51e9137aa0d 00000020:00000080:2.0:1788643067.191436:0:18698:0:(genops.c:885:class_export_put()) final put ffff9cabc7db6000/371cd762-ea78-4bcd-8c54-d51e9137aa0d 00000001:00100000:2.0:1788643067.191441:0:18698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cbf4bba2-7433-41d2-8c45-307c35e3cbbe 00000020:00000080:2.0:1788643067.191443:0:18698:0:(genops.c:885:class_export_put()) final put ffff9cacd8153800/cbf4bba2-7433-41d2-8c45-307c35e3cbbe 00000020:00000080:3.0:1788643067.191507:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfe794800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788643067.191547:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7db6000/371cd762-ea78-4bcd-8c54-d51e9137aa0d for lustre-OST0000 00000020:00000080:3.0:1788643067.191566:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacd8153800/cbf4bba2-7433-41d2-8c45-307c35e3cbbe for lustre-OST0000 00000020:00000080:3.0:1788643067.191601:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacfe793000 for lustre-OST0000 00000020:00000080:3.0:1788643067.191608:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc7db2000 for lustre-OST0000 00000020:00000080:3.0:1788643067.191611:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacfcf50000 for lustre-OST0000 00000020:00080000:3.0:1788643067.200066:0:20764:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9cabc7923380) has no exports 00000020:00000080:3.0:1788643067.251101:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3417 00000020:00000080:3.0:1788643067.251131:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cacfd793800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788643067.251205:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788643067.251285:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788643067.251295:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788643067.251300:0:20764:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9cabc7924d40) has no exports 00000020:00000080:0.0:1788643067.251313:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfd793800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788643067.251598:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3410 00000020:00000080:2.0:1788643067.251604:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cacda6f9000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788643067.251660:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788643067.251667:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788643067.251670:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cacda6ff800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788643067.251672:0:20764:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacda6ff800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788643067.251681:0:20764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788643067.251814:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacda6f9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788643067.788177:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643068.107866:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696860928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788643068.107932:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643068.108001:0:19992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696860928 00000100:00100000:0.0:1788643068.108007:0:19992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696860928 00000100:00100000:0.0:1788643068.108062:0:19992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788643068.108072:0:19992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696860928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788643068.108101:0:19992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788643068.109096:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788643068.109119:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696861056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788643068.109160:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788643068.109236:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788643068.109287:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696860928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788643068.111140:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696861056 00000100:00100000:3.0:1788643068.111152:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696861056 00000100:00100000:3.0:1788643068.111219:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788643068.111229:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696861056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788643068.111257:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788643068.111339:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696861056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643068.111347:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788643068.111347:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788643068.111543:0:19992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696860928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643068.111553:0:19992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788643068.113157:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875527696861568:0@lo:400:kworker.0 00000100:00100000:3.0:1788643068.113414:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696861056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788643068.113441:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01073fa7-a753-425c-8af1-85d79a3a8f8c:3643:1875527696861184:0@lo:400:kworker.0 00000100:00100000:2.0:1788643068.114486:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643068.114544:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc899d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875527696861440:0@lo:400:kworker.0 00000100:00100000:2.0:1788643068.114572:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643068.114594:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875527696861952:0@lo:400:kworker.0 00000100:00100000:2.0:1788643068.114615:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643068.114642:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788643068.114650:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696861312:0@lo:400:kworker.0 00000100:00100000:2.0:1788643068.114676:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643068.114696:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875527696861824:0@lo:400:kworker.0 00000100:00100000:2.0:1788643068.114716:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643068.114746:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696861568 00000100:00100000:2.0:1788643068.114753:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696861568 00000100:00100000:2.0:1788643068.114780:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696861440 00000100:00100000:2.0:1788643068.114783:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696861440 00000100:00100000:2.0:1788643068.114791:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696861952 00000100:00100000:2.0:1788643068.114794:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696861952 00000100:00100000:2.0:1788643068.114819:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696861824 00000100:00100000:2.0:1788643068.114822:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696861824 00000100:00100000:2.0:1788643068.114957:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788643068.114968:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875527696861952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643068.115018:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875527696861952:12345-0@lo:400:kworker.0 Request processed in 52us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643068.115037:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788643068.115057:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788643068.115060:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875527696861568:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788643068.115066:0:17193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788643068.115096:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875527696861568:12345-0@lo:400:kworker.0 Request processed in 34us (613us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788643068.115102:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788643068.115115:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788643068.115118:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875527696861440:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788643068.115122:0:17193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788643068.115148:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875527696861440:12345-0@lo:400:kworker.0 Request processed in 26us (574us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788643068.115155:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788643068.115168:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788643068.115172:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875527696861824:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788643068.115176:0:17193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788643068.115200:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696861312 00000100:00100000:0.0:1788643068.115206:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696861312 00000100:00100000:0.0:1788643068.115232:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788643068.115238:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875527696861312:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788643068.115243:0:17198:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:1.0:1788643068.115334:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788643068.115359:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788643068.115364:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9cabc7ce3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788643068.115395:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788643068.121058:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875527696861824:12345-0@lo:400:kworker.0 Request processed in 5872us (6329us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788643068.121058:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875527696861312:12345-0@lo:400:kworker.0 Request processed in 5814us (6376us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788643068.121083:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788643068.121084:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788643068.121155:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788643068.121161:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cacc835e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788643068.121165:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788643068.121170:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cacc835e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788643068.121174:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1788643068.121181:0:3645:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9cacc835e000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643068.121337:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7455180 x1875527696862080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788643068.121413:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696862080:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788643068.121448:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643068.121507:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacfd423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696861312:0@lo:400:kworker.0 00000100:00080000:2.0:1788643068.121523:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788643068.121526:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cabc7980000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788643068.121529:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788643068.121532:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cabc7980000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788643068.121536:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 513 00000100:00080000:2.0:1788643068.121540:0:3645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cabc7980000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643068.121554:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7457100 x1875527696862208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788643068.121587:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875527696862208:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788643068.121615:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643068.121647:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696862208 00000100:00100000:0.0:1788643068.121653:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696862208 00000100:00100000:0.0:1788643068.121692:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788643068.121698:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875527696862208:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788643068.121712:0:17194:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788643068.121754:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875527696861824:0@lo:400:kworker.0 00000100:00080000:2.0:1788643068.121770:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788643068.121909:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cacda401800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788643068.121913:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788643068.121916:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cacda401800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788643068.121920:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1788643068.121924:0:3645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9cacda401800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643068.121939:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7454000 x1875527696862336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788643068.121951:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc899d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875527696861440:0@lo:400:kworker.0 00010000:00080000:2.0:1788643068.121966:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7457480 x1875527696861952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643068.121982:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875527696861952:0@lo:400:kworker.0 00000100:00100000:2.0:1788643068.122028:0:17935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696862080 00000100:00100000:2.0:1788643068.122032:0:17935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696862080 00000100:00100000:2.0:1788643068.122053:0:17935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788643068.122057:0:17935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1875527696862080:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788643068.122065:0:17935:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788643068.122101:0:17935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1875527696862080:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 42us (652us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788643068.122107:0:17935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788643068.122937:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643068.122972:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc12a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875527696861696:0@lo:400:kworker.0 00000100:00100000:3.0:1788643068.123000:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643068.123040:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696861696 00000100:00100000:2.0:1788643068.123044:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696861184 00000100:00100000:3.0:1788643068.123045:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696861696 00000100:00100000:2.0:1788643068.123052:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696861184 00000100:00100000:2.0:1788643068.123092:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788643068.123103:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788643068.123104:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01073fa7-a753-425c-8af1-85d79a3a8f8c+19:3643:x1875527696861184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643068.123115:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875527696861696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643068.123155:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01073fa7-a753-425c-8af1-85d79a3a8f8c+19:3643:x1875527696861184:12345-0@lo:400:kworker.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643068.123164:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875527696861696:12345-0@lo:400:kworker.0 Request processed in 51us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643068.123165:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788643068.123176:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788643068.123245:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01073fa7-a753-425c-8af1-85d79a3a8f8c:3643:1875527696861184:0@lo:400:kworker.0 00010000:00080000:2.0:1788643068.123257:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc12a9f80 x1875527696861696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643068.123267:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc12a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875527696861696:0@lo:400:kworker.0 00000100:00100000:2.0:1788643068.123316:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875527696862336:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788643068.123341:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788643068.123363:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc835e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788643068.123368:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788643068.123395:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696862080:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788643068.123421:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696862336 00000100:00100000:2.0:1788643068.123425:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696862336 00000100:00100000:2.0:1788643068.123443:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788643068.123448:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1875527696862336:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788643068.123456:0:20193:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788643068.123485:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1875527696862336:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 37us (144us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788643068.123492:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788643068.123510:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacda401800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788643068.123514:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788643068.123517:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875527696862336:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1788643068.123543:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788643068.128796:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9cabc7ce3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788643068.128805:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1788643068.128813:0:3642:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cabc7ce3800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788643068.128850:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7ecd880 x1875527696862464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788643068.128878:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875527696861568:0@lo:400:kworker.0 00000100:00100000:2.0:1788643068.128967:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875527696862464:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788643068.129038:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643068.129414:0:20193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696862464 00000100:00100000:1.0:1788643068.129421:0:20193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696862464 00000100:00100000:1.0:1788643068.129458:0:20193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788643068.129465:0:20193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1875527696862464:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788643068.129481:0:20193:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788643068.129542:0:20193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1875527696862464:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 76us (504us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788643068.129550:0:20193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788643068.129591:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc7ce3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788643068.129597:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788643068.129601:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875527696862464:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788643068.153957:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875527696862208:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 32252us (32335us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788643068.153971:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788643068.154089:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc7980000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788643068.154095:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788643068.154100:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875527696862208:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1788643068.812041:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788643069.648007:0:17927:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788643069.648023:0:17927:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1788643069.648028:0:17927:0:(genops.c:885:class_export_put()) final put ffff9cabc7fc0000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788643069.648048:0:17927:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 371cd762-ea78-4bcd-8c54-d51e9137aa0d 00000001:00080000:3.0:1788643069.648053:0:17927:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1788643069.648055:0:17927:0:(genops.c:885:class_export_put()) final put ffff9cace70d6800/371cd762-ea78-4bcd-8c54-d51e9137aa0d 00000001:00100000:3.0:1788643069.648060:0:17927:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cbf4bba2-7433-41d2-8c45-307c35e3cbbe 00000001:00080000:3.0:1788643069.648063:0:17927:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1788643069.648065:0:17927:0:(genops.c:885:class_export_put()) final put ffff9cabc1c82000/cbf4bba2-7433-41d2-8c45-307c35e3cbbe 00000020:00000080:0.0:1788643069.648214:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7fc0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788643069.648284:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cace70d6800/371cd762-ea78-4bcd-8c54-d51e9137aa0d for lustre-MDT0001 00000020:00000080:0.0:1788643069.648309:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc1c82000/cbf4bba2-7433-41d2-8c45-307c35e3cbbe for lustre-MDT0001 00000020:00000080:0.0:1788643069.648328:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc7f31800 for lustre-MDT0001 00000020:00000080:0.0:1788643069.648333:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cace70d2800 for lustre-MDT0001 00000020:00000080:0.0:1788643069.648336:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc1c84800 for lustre-MDT0001 00000001:00100000:2.0:1788643069.648983:0:17173:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788643069.648988:0:17173:0:(genops.c:885:class_export_put()) final put ffff9cabc76bb000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788643069.649014:0:17173:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 371cd762-ea78-4bcd-8c54-d51e9137aa0d 00000001:00080000:2.0:1788643069.649019:0:17173:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1788643069.649022:0:17173:0:(genops.c:885:class_export_put()) final put ffff9cace70d4000/371cd762-ea78-4bcd-8c54-d51e9137aa0d 00000001:00100000:2.0:1788643069.649027:0:17173:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cbf4bba2-7433-41d2-8c45-307c35e3cbbe 00000001:00080000:2.0:1788643069.649031:0:17173:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:2.0:1788643069.649035:0:17173:0:(genops.c:885:class_export_put()) final put ffff9cabc7987800/cbf4bba2-7433-41d2-8c45-307c35e3cbbe 00000020:00000080:0.0:1788643069.649155:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc76bb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788643069.649206:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cace70d4000/371cd762-ea78-4bcd-8c54-d51e9137aa0d for lustre-MDT0000 00000020:00000080:0.0:1788643069.649230:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7987800/cbf4bba2-7433-41d2-8c45-307c35e3cbbe for lustre-MDT0000 00000020:00000080:0.0:1788643069.649294:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacd0e15000 for lustre-MDT0000 00000020:00000080:0.0:1788643069.649299:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cace70d1800 for lustre-MDT0000 00000020:00000080:0.0:1788643069.649302:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc1c87800 for lustre-MDT0000 00010000:00010000:2.0:1788643069.835529:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788643069.900312:0:17949:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788643070.860183:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643071.883608:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643072.908037:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643073.228013:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788643073.228033:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696862592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788643073.228091:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643073.228157:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696862592 00000100:00100000:2.0:1788643073.228164:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696862592 00000100:00100000:2.0:1788643073.228212:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788643073.228221:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696862592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788643073.228255:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788643073.228293:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696862592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643073.228301:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788643073.228322:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788643073.228349:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696862592:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788643073.228645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788643073.228649:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788643073.228653:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cacc835e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788643073.228658:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 549 00000100:00080000:0.0:1788643073.228661:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788643073.228666:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9cacc835e000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643073.228683:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacf7f06a00 x1875527696862976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788643073.228704:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788643073.228707:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788643073.228709:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cacda401800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788643073.228724:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 549 00000100:00080000:0.0:1788643073.228727:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788643073.228730:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9cacda401800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643073.228743:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacf7f05500 x1875527696863232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788643073.228753:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1788643073.228755:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01073fa7-a753-425c-8af1-85d79a3a8f8c:3644:1875527696862848:0@lo:400:kworker.0 00000100:00080000:0.0:1788643073.228756:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788643073.228757:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cabc7ce3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788643073.228760:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 549 00000100:00080000:0.0:1788643073.228763:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788643073.228765:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cabc7ce3800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643073.228775:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc9998e00 x1875527696863360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788643073.228790:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643073.228815:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788643073.228821:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696863104:0@lo:400:kworker.0 00000100:00100000:3.0:1788643073.228845:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788643073.229078:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788643073.229081:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788643073.229083:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cabc7980000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788643073.229087:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 549 00000100:00080000:0.0:1788643073.229089:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788643073.229093:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cabc7980000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643073.229105:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc9999f80 x1875527696863616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788643073.229223:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696862976:0@lo:38:kworker.0 00000100:00100000:2.0:1788643073.229263:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643073.229288:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875527696863232:0@lo:38:kworker.0 00000100:00100000:2.0:1788643073.229309:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643073.229333:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875527696863360:0@lo:38:kworker.0 00000100:00100000:2.0:1788643073.229354:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643073.229367:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875527696863616:0@lo:38:kworker.0 00000100:00100000:0.0:1788643073.229501:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696862976 00000100:00100000:0.0:1788643073.229507:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696862976 00000100:00100000:0.0:1788643073.229532:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788643073.229538:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875527696862976:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788643073.229551:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696863232 00000100:00100000:3.0:1788643073.229554:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696863232 00010000:02000000:0.0:1788643073.229557:0:17199:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788643073.229578:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696863360 00000100:00100000:3.0:1788643073.229580:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696863360 00000100:00100000:3.0:1788643073.229594:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788643073.229598:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875527696863232:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788643073.229606:0:17195:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788643073.229637:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875527696863232:12345-0@lo:38:kworker.0 Request processed in 37us (326us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788643073.229725:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788643073.229747:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788643073.229751:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875527696863360:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788643073.229758:0:17195:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788643073.229785:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875527696863360:12345-0@lo:38:kworker.0 Request processed in 32us (429us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788643073.229790:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788643073.229829:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696862720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788643073.229852:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643073.229871:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875527696863744:0@lo:400:kworker.0 00000100:00100000:3.0:1788643073.229890:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643073.229907:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788643073.229912:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875527696863488:0@lo:400:kworker.0 00000100:00100000:3.0:1788643073.229932:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643073.229954:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696863744 00000100:00100000:3.0:1788643073.229957:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696863744 00000100:00100000:3.0:1788643073.229985:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696863488 00000100:00100000:3.0:1788643073.229988:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696863488 00000100:00100000:3.0:1788643073.230003:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788643073.230008:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875527696863744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643073.230042:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8a0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875527696863744:12345-0@lo:400:kworker.0 Request processed in 34us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643073.230047:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643073.230049:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788643073.230059:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696863616 00000100:00100000:3.0:1788643073.230062:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696863616 00000100:00080000:2.0:1788643073.230071:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacda401800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788643073.230072:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788643073.230075:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788643073.230077:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875527696863488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643073.230079:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875527696863232:0@lo:38:kworker.0 00000100:00080000:2.0:1788643073.230096:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc7ce3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788643073.230099:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788643073.230102:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875527696863360:0@lo:38:kworker.0 00000100:00080000:2.0:1788643073.230129:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788643073.230149:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788643073.230154:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875527696863616:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788643073.230162:0:17193:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788643073.230191:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875527696863616:12345-0@lo:38:kworker.0 Request processed in 36us (143us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788643073.230196:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788643073.230218:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc7980000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788643073.230222:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788643073.230225:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875527696863616:0@lo:38:kworker.0 00000100:00100000:1.0:1788643073.230304:0:19890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696863104 00000100:00100000:1.0:1788643073.230310:0:19890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696863104 00000100:00100000:1.0:1788643073.230347:0:19890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788643073.230355:0:19890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696863104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643073.230412:0:19890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696863104:12345-0@lo:400:kworker.0 Request processed in 59us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643073.230418:0:19890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788643073.230445:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696862848 00000100:00100000:1.0:1788643073.230461:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696862848 00000100:00100000:1.0:1788643073.230486:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788643073.230493:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01073fa7-a753-425c-8af1-85d79a3a8f8c+19:3644:x1875527696862848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643073.230538:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01073fa7-a753-425c-8af1-85d79a3a8f8c+19:3644:x1875527696862848:12345-0@lo:400:kworker.0 Request processed in 45us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643073.230545:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1788643073.230596:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788643073.230621:0:19992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696862720 00000100:00100000:1.0:1788643073.230625:0:19992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696862720 00000100:00100000:3.0:1788643073.230634:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875527696863488:12345-0@lo:400:kworker.0 Request processed in 555us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643073.230665:0:19992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788643073.230671:0:19992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696862720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788643073.230689:0:19992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788643073.230719:0:19992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696862720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643073.230725:0:19992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788643073.230771:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696863104:0@lo:400:kworker.0 00000100:00100000:1.0:1788643073.230780:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01073fa7-a753-425c-8af1-85d79a3a8f8c:3644:1875527696862848:0@lo:400:kworker.0 00000100:00100000:3.0:1788643073.230847:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1788643073.233587:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc999b480 x1875527696863488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643073.233605:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875527696863488:0@lo:400:kworker.0 00000100:00100000:2.0:1788643073.233632:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696862720:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788643073.233645:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc9999500 x1875527696863744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643073.233654:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875527696863744:0@lo:400:kworker.0 00000100:00080000:3.0:1788643073.255063:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc835e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788643073.255075:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788643073.255080:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696862976:0@lo:38:kworker.0 00000100:00100000:0.0:1788643073.260454:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875527696862976:12345-0@lo:38:kworker.0 Request processed in 30905us (31180us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788643073.260470:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000020:01000000:2.0:1788643073.291520:0:20764:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cacfe4ef300 - data ffff9cace7caea20/ffff9cacfcf61c00 00000020:01000000:2.0:1788643073.291689:0:20764:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cacfd4258a0 - data ffff9cace7c70e58/ffff9cacc8dda400 00000001:00000004:2.0:1788643073.298120:0:20764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:3.0:1788643073.350697:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788643073.350705:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788643073.350718:0:20764:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9cacfd422d80 x1875527696860032/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788643077 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643073.350744:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788643073.358315:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788643073.358323:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788643073.358400:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788643073.358403:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788643073.364037:0:17217:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788643073.364043:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788643073.364055:0:17217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788643073.367068:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788643073.367077:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788643073.367100:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788643073.367103:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788643073.368732:0:17219:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788643073.368738:0:17219:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1788643073.368749:0:17219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788643073.369986:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c33df 00000020:00000080:3.0:1788643073.369997:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cacd11e0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788643073.372049:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacd11e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788643073.372717:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c33f4 00000020:00000080:3.0:1788643073.372726:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cacf0641800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788643073.372743:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788643073.372748:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643073.372755:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788643073.372759:0:20764:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9cabc79219c0) has no exports 00000020:00000080:0.0:1788643073.372976:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacf0641800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1788643073.373979:0:20764:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788643073.373990:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3456 00000020:00000080:3.0:1788643073.373997:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cabc7910800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788643073.374064:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788643073.374079:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643073.374085:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788643073.374089:0:20764:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9cabc7a3b380) has no exports 00000020:00000080:3.0:1788643073.374096:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c344f 00000020:00000080:3.0:1788643073.374100:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cacfe59f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788643073.377659:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7910800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788643073.379774:0:20764:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788643073.379883:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788643073.379888:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1788643073.379894:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788643073.379896:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788643073.380014:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643073.380024:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788643073.380033:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3441 00000020:00000080:3.0:1788643073.380041:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cabc5da4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788643073.380586:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfe59f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788643073.380601:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacfe599000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788643073.380607:0:8:0:(genops.c:885:class_export_put()) final put ffff9cabc5da5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788643073.380609:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc5da5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788643073.380613:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788643073.383065:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788643073.383079:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643073.383088:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788643073.383093:0:20764:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9cacf573b380) has no exports 00000020:00000080:3.0:1788643073.383101:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c343a 00000020:00000080:3.0:1788643073.383109:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cabc5da5000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788643073.383137:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc5da4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788643073.383908:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc5da5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788643073.384548:0:20764:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788643073.384553:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788643073.384557:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788643073.384564:0:20764:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788643073.384566:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788643073.384608:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643073.384616:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788643073.384630:0:20764:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788643073.384636:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c342c 00000020:00000080:3.0:1788643073.384643:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cabc5da3000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788643073.384648:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788643073.384652:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643073.384664:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788643073.384668:0:20764:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9cabc7c3cd40) has no exports 00000020:00000080:3.0:1788643073.384673:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3425 00000020:00000080:3.0:1788643073.384677:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cacfd797800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788643073.385334:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc5da4000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788643073.385348:0:8:0:(genops.c:885:class_export_put()) final put ffff9cabc5da6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788643073.385352:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc5da6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788643073.385358:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788643073.385655:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc5da3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788643073.385662:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfd797800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788643073.399133:0:20764:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788643073.399141:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788643073.399145:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788643073.399153:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788643073.399216:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643073.399228:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788643073.399251:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacfd794800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788643073.399263:0:8:0:(genops.c:885:class_export_put()) final put ffff9cacfd796800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788643073.399266:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfd796800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788643073.399267:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643073.399273:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788643073.399275:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788643073.399277:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cabc88a5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788643073.399281:0:20764:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc88a5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788643073.399292:0:20764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788643073.399421:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c33fb 00000020:00000080:3.0:1788643073.399429:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cacf0645800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788643073.399443:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788643073.399448:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643073.399452:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788643073.399456:0:20764:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9cabc7920000) has no exports 00000020:00000080:3.0:1788643073.399479:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643073.399483:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788643073.399487:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3402 00000020:00000080:3.0:1788643073.399491:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cacf0646000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788643073.399499:0:20764:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cabc89e5800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788643073.399502:0:20764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cabc89e5800 3 00000020:01000004:3.0:1788643073.399505:0:20764:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cabc89e5800 from lustre-MDT0000 00000020:00000080:3.0:1788643073.399526:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643073.399530:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788643073.399533:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cace7169800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788643073.399536:0:20764:0:(genops.c:844:class_export_destroy()) destroying export ffff9cace7169800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788643073.399554:0:20764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1788643073.399595:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacf0645800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:3.0:1788643073.399599:0:20764:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:00000080:1.0:1788643073.399600:0:8:0:(genops.c:885:class_export_put()) final put ffff9cacf0644800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788643073.399604:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacf0644800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:3.0:1788643073.399606:0:20764:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788643073.399608:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000000:3.0:1788643073.399610:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788643073.399615:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643073.399619:0:20764:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788643073.399624:0:20764:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9cabc88a0000 01073fa7-a753-425c-8af1-85d79a3a8f8c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788643073.399637:0:20764:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9cabc7c38000) has exports, disconnecting them 00000020:00080000:3.0:1788643073.399642:0:20764:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9cabc88a0000), last request at 1788642995 00000020:00000080:3.0:1788643073.399656:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c33a0 00000020:00010000:3.0:1788643073.399661:0:20764:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cabc88a0000: total 2 00000100:00080000:3.0:1788643073.399665:0:20764:0:(import.c:65:import_set_state_nolock()) ffff9cabc88a4800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788643073.399667:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacf0646000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1788643073.399684:0:20764:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cabc88a0000): rc 0 00000020:00080000:3.0:1788643073.399688:0:20764:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9cabc7c38000) has no exports 00000020:00010000:0.0:1788643073.399707:0:17950:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cabc88a0000: total 0 00010000:00010000:0.0:1788643073.399713:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643073.399755:0:17950:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cabc88a0000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788643073.399785:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacf6d3d800/0x119ccc6e683c396c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c3965 expref: 14 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643073.399803:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cabc7494e00/0x119ccc6e683c37d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c37cf expref: 13 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643073.399817:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cabc7494c00/0x119ccc6e683c3766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c375f expref: 12 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643073.399835:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cad02174800/0x119ccc6e683c3608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c3601 expref: 11 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643073.399838:0:17188:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9cabc7cf5200:17188] 2 exiting: rc = 0 00010000:00010000:0.0:1788643073.399848:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacda5b4800/0x119ccc6e683c34d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c34cd expref: 10 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643073.399873:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacc13aba00/0x119ccc6e683c34e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c34db expref: 9 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643073.399882:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacfe7aa000/0x119ccc6e683c3790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c3789 expref: 8 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643073.399892:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cabc7494400/0x119ccc6e683c33b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c33ae expref: 7 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643073.399904:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacf6d3ca00/0x119ccc6e683c3950 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c3949 expref: 6 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643073.399916:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacda5b5800/0x119ccc6e683c34c6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c34bf expref: 5 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643073.399931:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cabc7494200/0x119ccc6e683c3632 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c362b expref: 4 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643073.399942:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacf6d3c800/0x119ccc6e683c395e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c3957 expref: 3 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643073.399954:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cabc7495600/0x119ccc6e683c3583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x119ccc6e683c357c expref: 2 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643073.399961:0:17187:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9cabc5d16200:17187] 1 exiting: rc = 0 00010000:00010000:0.0:1788643073.399966:0:17950:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cabc88a0000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788643073.399986:0:17950:0:(genops.c:885:class_export_put()) final put ffff9cabc88a0000/01073fa7-a753-425c-8af1-85d79a3a8f8c 00010000:00010000:0.0:1788643073.399997:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643073.400000:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643073.400002:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788643073.400029:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc88a0000/01073fa7-a753-425c-8af1-85d79a3a8f8c for MGS 00000020:00000080:0.0:1788643073.400057:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc88a4800 for MGS 00000100:00100000:1.0:1788643073.400099:0:17186:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9cacefd7a000:17186] 0 exiting: rc = 1 00000100:00100000:3.0:1788643073.400256:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400266:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400273:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400279:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400283:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400296:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400301:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400305:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400310:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400315:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400320:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400325:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400329:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400334:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400339:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400343:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400348:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400354:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400359:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400372:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400462:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400474:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400481:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400488:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400495:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400501:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400508:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400516:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400536:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400544:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400552:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400559:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400567:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400575:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400582:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400589:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400595:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400601:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400612:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400620:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400632:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400642:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400648:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400654:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400670:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400676:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400911:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400920:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400928:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400936:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400943:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400950:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400958:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400966:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400988:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.400996:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.401003:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.401011:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.401018:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.401026:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.401033:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.401039:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.401046:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643073.401054:0:20764:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788643073.402851:0:20764:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cabc754ea20 - data ffff9cace7c62510/ffff9cacfdc78c00 00000020:01000000:3.0:1788643073.402969:0:20764:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cacd2ddd900 - data ffff9cacc9c23e58/ffff9cabc1c92000 00000020:00000080:3.0:1788643073.403841:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c338b 00000020:00000080:3.0:1788643073.403851:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cabc88ae000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788643073.403870:0:20764:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cabc89e5800 from MGS, refs=2 00000020:01000004:3.0:1788643073.403873:0:20764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cabc89e5800 2 00000020:01000004:3.0:1788643073.403876:0:20764:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cabc89e5800 from MGS 00000020:00000080:3.0:1788643073.403903:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643073.403909:0:20764:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788643073.403912:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cabc88aa800/MGS 00000020:00000080:3.0:1788643073.403915:0:20764:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc88aa800/MGS for MGS 00000020:00000080:0.0:1788643073.403920:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc88ae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788643073.403924:0:20764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788643073.403996:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788643073.404000:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643073.404005:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788643073.404011:0:20764:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9cacf5762800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788643073.404016:0:20764:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9cacf573cd40) has exports, disconnecting them 00000020:00080000:3.0:1788643073.404021:0:20764:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9cacf5762800), last request at 1788642995 00000020:00000080:3.0:1788643073.404024:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c348e 00000020:00080000:3.0:1788643073.404033:0:20764:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cacf5762800): rc 0 00000020:00000080:3.0:1788643073.404037:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cacf5762800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788643073.405502:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacf5762800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788643073.410679:0:20764:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788643073.410700:0:20764:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788643073.410704:0:20764:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788643073.410710:0:20764:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788643073.410854:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643073.410862:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788643073.410869:0:20764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cabc89e5800 1 00000020:00000080:3.0:1788643073.410876:0:20764:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c337d 00000020:00000080:3.0:1788643073.410884:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cabc88aa000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788643073.410889:0:20764:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788643073.410893:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643073.410897:0:20764:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788643073.410900:0:20764:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9cabc7a38000) has no exports 00000020:00000080:1.0:1788643073.410972:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacf5763000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788643073.410979:0:8:0:(genops.c:885:class_export_put()) final put ffff9cacf5765800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788643073.410982:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacf5765800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788643073.410991:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788643073.411063:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc88aa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788643073.441011:0:20764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788643073.441024:0:20764:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788643073.441029:0:20764:0:(genops.c:885:class_export_put()) final put ffff9cabc89e0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788643073.441034:0:20764:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc89e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788643073.441047:0:20764:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788643073.441192:0:20764:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cabc89e3800 00000020:02000400:0.0:1788643073.441260:0:20764:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788643073.932282:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643074.955614:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643075.979664:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643077.004662:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788643077.413088:0:20965:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788643077.442182:0:20965:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788643077.442244:0:20965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab800/0x119ccc6e683c357c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3583 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.442259:0:20965:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab800/0x119ccc6e683c357c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3583 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.442266:0:20965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab800/0x119ccc6e683c357c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3583 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.442273:0:20965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab800/0x119ccc6e683c357c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3583 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.442303:0:20965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788643077.442309:0:20965:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788643077.442330:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788643077.442334:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788643077.442340:0:20965:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788643077.442346:0:20965:0:(import.c:65:import_set_state_nolock()) ffff9cacda401800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788643077.442350:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788643077.442352:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788643077.442355:0:20965:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788643077.443260:0:20965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175c00/0x119ccc6e683c34db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c34e2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443272:0:20965:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175c00/0x119ccc6e683c34db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c34e2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443278:0:20965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175c00/0x119ccc6e683c34db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c34e2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443298:0:20965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cad02175c00/0x119ccc6e683c34db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c34e2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443318:0:20965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788643077.443325:0:20965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7495a00/0x119ccc6e683c37cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c37d6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443330:0:20965:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7495a00/0x119ccc6e683c37cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c37d6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443336:0:20965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7495a00/0x119ccc6e683c37cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c37d6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443341:0:20965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cabc7495a00/0x119ccc6e683c37cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c37d6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443361:0:20965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788643077.443367:0:20965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3965 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c396c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443375:0:20965:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3965 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c396c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443409:0:20965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3965 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c396c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443416:0:20965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c396c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443432:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788643077.443436:0:20965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788643077.443458:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab800/0x119ccc6e683c357c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3583 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443458:0:20965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c34cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c34d4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443500:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc13ab800 already unused, calling callback (ffffffffc1320c20) 00010000:00010000:2.0:1788643077.443501:0:20965:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c34cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c34d4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788643077.443511:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab800/0x119ccc6e683c357c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3583 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443515:0:20965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c34cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c34d4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443538:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab800/0x119ccc6e683c357c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c3583 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443539:0:20965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c34cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c34d4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643077.443554:0:20965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788643077.443560:0:20965:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 10000000:00010000:3.0:1788643077.443574:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab800/0x119ccc6e683c357c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c3583 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788643077.443581:0:20965:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 10000000:01000000:3.0:1788643077.443582:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:01000000:2.0:1788643077.443589:0:20965:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 10000000:01000000:3.0:1788643077.443590:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788643077.443597:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000020:00000080:2.0:1788643077.443598:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788643077.443606:0:20965:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788643077.443614:0:20965:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9cace70d0000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788643077.443621:0:20965:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9cacfe796000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788643077.443625:0:20965:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9cabc740b380) has exports, disconnecting them 00000020:00080000:2.0:1788643077.443630:0:20965:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9cace70d0000), last request at 1788643073 00000020:00000080:2.0:1788643077.443637:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c37ba 00010000:00010000:3.0:1788643077.443660:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab800/0x119ccc6e683c357c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c3583 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788643077.443660:0:20965:0:(import.c:65:import_set_state_nolock()) ffff9cace70d4800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788643077.443691:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1788643077.443719:0:20965:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cace70d0000): rc 0 00000020:00000080:2.0:1788643077.443723:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cace70d0000/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:3.0:1788643077.443727:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab800/0x119ccc6e683c357c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c3583 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443737:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc13ab800/0x119ccc6e683c357c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c3583 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788643077.443739:0:20965:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9cacfe796000), last request at 1788643073 00000020:00000080:2.0:1788643077.443753:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c365c 00010000:00010000:3.0:1788643077.443757:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00080000:2.0:1788643077.443762:0:20965:0:(import.c:65:import_set_state_nolock()) ffff9cacfe790800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788643077.443763:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cad02175c00/0x119ccc6e683c34db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c34e2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788643077.443777:0:20965:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cacfe796000): rc 0 00000020:00000080:2.0:1788643077.443780:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacfe796000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788643077.443787:0:20965:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa83bc0dd3ae0 00010000:00010000:3.0:1788643077.443789:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cad02175c00 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:3.0:1788643077.443797:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cad02175c00/0x119ccc6e683c34db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c34e2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443809:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cad02175c00/0x119ccc6e683c34db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c34e2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788643077.443810:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788643077.443818:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 10000000:00010000:3.0:1788643077.443827:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cad02175c00/0x119ccc6e683c34db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c34e2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643077.443834:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788643077.443836:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788643077.443839:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788643077.443857:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cad02175c00/0x119ccc6e683c34db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c34e2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443864:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788643077.443871:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cad02175c00/0x119ccc6e683c34db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c34e2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443891:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cad02175c00/0x119ccc6e683c34db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c34e2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443901:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788643077.443905:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cabc7495a00/0x119ccc6e683c37cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c37d6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443910:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495a00 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:3.0:1788643077.443913:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cabc7495a00/0x119ccc6e683c37cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c37d6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443920:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cabc7495a00/0x119ccc6e683c37cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c37d6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788643077.443927:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cabc7495a00/0x119ccc6e683c37cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c37d6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643077.443932:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788643077.443934:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788643077.443937:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788643077.443952:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cabc7495a00/0x119ccc6e683c37cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c37d6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443957:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788643077.443991:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cabc7495a00/0x119ccc6e683c37cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c37d6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.443998:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cabc7495a00/0x119ccc6e683c37cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c37d6 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.444025:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788643077.444029:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c396c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.444035:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0031400 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:3.0:1788643077.444038:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3965 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c396c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.444046:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c396c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788643077.444052:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c396c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643077.444058:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788643077.444060:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788643077.444062:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788643077.444080:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c396c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.444086:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788643077.444093:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3965 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c396c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.444099:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3965 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c396c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.444107:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788643077.444110:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c34cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c34d4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.444122:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cad02175600 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:3.0:1788643077.444125:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c34cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c34d4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.444131:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c34cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c34d4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788643077.444138:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c34cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c34d4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643077.444143:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788643077.444146:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788643077.444147:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788643077.444165:0:17181:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c34cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c34d4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.444171:0:17181:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788643077.444175:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c34cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c34d4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.444181:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c34cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x119ccc6e683c34d4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643077.444194:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643077.444195:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643077.444197:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643077.444242:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01073fa7-a753-425c-8af1-85d79a3a8f8c:3645:1875527696864000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788643077.444333:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643077.444452:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788643077.444467:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01073fa7-a753-425c-8af1-85d79a3a8f8c:3645:1875527696863872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788643077.444493:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643077.444514:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01073fa7-a753-425c-8af1-85d79a3a8f8c:3645:1875527696864384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788643077.444534:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788643077.444570:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cace70d0000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788643077.444627:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfe796000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00080000:2.0:1788643077.444649:0:20965:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:00000080:3.0:1788643077.444655:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cace70d4800 for lustre-MDT0001 00000100:00080000:2.0:1788643077.444657:0:20965:0:(import.c:65:import_set_state_nolock()) ffff9cacc835e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:3.0:1788643077.444662:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacfe790800 for lustre-MDT0001 00000100:00100000:3.0:1788643077.444682:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01073fa7-a753-425c-8af1-85d79a3a8f8c:3643:1875527696864256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788643077.444711:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643077.444731:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788643077.444743:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01073fa7-a753-425c-8af1-85d79a3a8f8c:3643:1875527696864128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788643077.444788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788643077.444821:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788643077.444826:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000100:00100000:3.0:1788643077.444832:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696864000 00000004:00080000:2.0:1788643077.444840:0:20965:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788643077.444843:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696864000 00000100:00100000:3.0:1788643077.444881:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696863872 00000100:00100000:3.0:1788643077.444884:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696863872 00000100:00100000:3.0:1788643077.444891:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696864384 00000100:00100000:3.0:1788643077.444893:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696864384 00000100:00100000:3.0:1788643077.444900:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696864256 00000100:00100000:3.0:1788643077.444903:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696864256 00000100:00100000:3.0:1788643077.444910:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696864128 00000100:00100000:3.0:1788643077.444912:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696864128 00000100:00100000:3.0:1788643077.444925:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788643077.444932:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1875527696864000:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788643077.444939:0:17180:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788643077 with bad export cookie 1269113969578881952 00010000:00010000:0.0:1788643077.445017:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643077.445136:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788643077.457368:0:20965:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788643077.457419:0:20965:0:(import.c:65:import_set_state_nolock()) ffff9cacfe792800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788643077.457443:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788643077.457447:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788643077.457469:0:20965:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788643077.457522:0:20965:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788643077.457530:0:20965:0:(import.c:65:import_set_state_nolock()) ffff9cabc76c7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788643077.457569:0:20965:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9cabc740b380) has no exports 00000100:00100000:0.0:1788643077.457898:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696864512:0@lo:9:umount.0 00000100:00100000:0.0:1788643077.457964:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643077.458004:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696864640:0@lo:9:umount.0 00000100:00100000:0.0:1788643077.458027:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643077.458185:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696864512 00000100:00100000:2.0:1788643077.458192:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696864512 00000100:00100000:2.0:1788643077.458253:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696864640 00000100:00100000:2.0:1788643077.458256:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696864640 00000100:00100000:2.0:1788643077.458278:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788643077.458286:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875527696864512:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788643077.458308:0:18701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c37c1 00000100:00080000:2.0:1788643077.458315:0:18701:0:(import.c:65:import_set_state_nolock()) ffff9cabc7983800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788643077.458356:0:18701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788643077.458515:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3641:x1875527696864512:12345-0@lo:9:umount.0 Request processed in 229us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643077.458524:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788643077.458541:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788643077.458549:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875527696864640:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788643077.458562:0:18701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c37f2 00000100:00080000:2.0:1788643077.458568:0:18701:0:(import.c:65:import_set_state_nolock()) ffff9cabc10e3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788643077.458589:0:18701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1788643077.458668:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3641:x1875527696864640:12345-0@lo:9:umount.0 Request processed in 120us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643077.458675:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788643077.461053:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788643077.461062:0:17189:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788643077.461074:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788643077.461123:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacfe792800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788643077.461146:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788643077.461149:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788643077.461156:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696864512:0@lo:9:umount.0 00000100:00080000:0.0:1788643077.461187:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc76c7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788643077.461197:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788643077.461198:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788643077.461201:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696864640:0@lo:9:umount.0 00010000:00010000:2.0:1788643077.465239:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643077.470960:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1875527696864000:12345-0@lo:103:ldlm_bl.0 Request processed in 26014us (26615us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788643077.471162:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788643077.471284:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788643077.471293:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1875527696863872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788643077.471300:0:17180:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788643077 with bad export cookie 1269113969578881952 00000100:00100000:3.0:1788643077.471340:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1875527696863872:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (26842us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788643077.471347:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788643077.471361:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788643077.471367:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1875527696864384:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788643077.471372:0:17180:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788643077 with bad export cookie 1269113969578881952 00000100:00080000:1.0:1788643077.472654:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788643077.472662:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cace7162000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788643077.472685:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788643077.474291:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1875527696864384:12345-0@lo:103:ldlm_bl.0 Request processed in 2910us (29744us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788643077.474307:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788643077.474350:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788643077.474359:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875527696864256:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788643077.474366:0:17180:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788643077 with bad export cookie 1269113969578881952 00000100:00100000:3.0:1788643077.474446:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875527696864256:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (29734us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788643077.474456:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788643077.474473:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788643077.474482:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacfe9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875527696864128:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788643077.474488:0:17180:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788643077 with bad export cookie 1269113969578881952 00000100:00080000:2.0:1788643077.474518:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1788643077.474526:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacfe9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3643:x1875527696864128:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (29746us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788643077.474533:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788643077.479735:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.118@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788643077.479740:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788643077.479752:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc8a08000 x1875527696864000/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788643093 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643077.479766:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc8a08380 x1875527696863872/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788643093 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643077.479774:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc8b47b80 x1875527696864384/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788643093 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643077.479782:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc8b44700 x1875527696864256/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788643093 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643077.479790:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc8a09180 x1875527696864128/t0(0) o103->MGC192.168.206.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788643093 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788643077.479798:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788643077.479801:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788643077.479802:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788643077.488017:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9cace7162000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788643077.488203:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8a09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01073fa7-a753-425c-8af1-85d79a3a8f8c:3643:1875527696864128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788643077.488215:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01073fa7-a753-425c-8af1-85d79a3a8f8c:3643:1875527696864256:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788643077.492349:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cace7162000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788643077.492364:0:3645:0:(import.c:545:import_select_connection()) MGC192.168.206.118@tcp: connect to NID 0@lo last attempt 476 00000100:00080000:1.0:1788643077.492374:0:3645:0:(import.c:665:import_select_connection()) MGC192.168.206.118@tcp: import ffff9cace7162000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643077.496534:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7454a80 x1875527696864768/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788643077.496594:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01073fa7-a753-425c-8af1-85d79a3a8f8c:3645:1875527696864384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788643077.496603:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8a08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01073fa7-a753-425c-8af1-85d79a3a8f8c:3645:1875527696864000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788643077.496637:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8a08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01073fa7-a753-425c-8af1-85d79a3a8f8c:3645:1875527696863872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788643077.496658:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01073fa7-a753-425c-8af1-85d79a3a8f8c:3641:1875527696864768:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788643077.496736:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875527696864768 offset 0 length 520: 4 00000020:00080000:3.0:1788643077.503708:0:20965:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9cabc740b380) has no exports 00000020:01000000:2.0:1788643077.547512:0:20965:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cacfe4ef180 - data ffff9cace7e64948/ffff9cacfcf61400 00000020:01000000:2.0:1788643077.548587:0:20965:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cacc2cab4e0 - data ffff9cacc2121e58/ffff9caceeda0800 00000001:00000004:2.0:1788643077.566534:0:20965:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788643077.619688:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788643077.619696:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788643077.619703:0:20965:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788643077.627922:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788643077.627930:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788643077.627989:0:20965:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788643077.627992:0:20965:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788643077.636877:0:17936:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788643077.636895:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788643077.636983:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788643077.639557:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788643077.639565:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788643077.639576:0:20965:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788643077.639578:0:20965:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788643077.640281:0:17938:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788643077.640285:0:17938:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788643077.640311:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788643077.642833:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c34f0 00000020:00000080:2.0:1788643077.642844:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacfe795000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788643077.643862:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3505 00000020:00000080:2.0:1788643077.643870:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacd07cf800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788643077.644118:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfe795000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788643077.644553:0:20965:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788643077.644594:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacd07cf800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1788643077.644610:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788643077.644685:0:20965:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788643077.644689:0:20965:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9cabc74099c0) has no exports 00000004:01000000:1.0:1788643077.644849:0:20965:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788643077.644858:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3559 00000020:00000080:1.0:1788643077.644863:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacd8155800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788643077.644990:0:20965:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788643077.644995:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788643077.645008:0:20965:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788643077.645011:0:20965:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9cacfdc8cd40) has no exports 00000020:00000080:1.0:1788643077.645016:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3552 00000020:00000080:1.0:1788643077.645020:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cabc76c3800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788643077.645043:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacd8155800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1788643077.645946:0:20965:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788643077.645951:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788643077.645955:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788643077.645960:0:20965:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788643077.645962:0:20965:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788643077.646052:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc76c3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788643077.646399:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788643077.646408:0:20965:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788643077.646415:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3544 00000020:00000080:1.0:1788643077.646422:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacc835b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788643077.646543:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc76c7800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788643077.646550:0:8:0:(genops.c:885:class_export_put()) final put ffff9cacc8359800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788643077.646553:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacc8359800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788643077.646559:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788643077.646778:0:20965:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788643077.646783:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788643077.646788:0:20965:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788643077.646791:0:20965:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9cabc7c3b380) has no exports 00000020:00000080:1.0:1788643077.646797:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3536 00000020:00000080:1.0:1788643077.646800:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacfe797000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788643077.646879:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacc835b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788643077.648478:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfe797000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788643077.648818:0:20965:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788643077.648823:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788643077.648827:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788643077.648833:0:20965:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788643077.648835:0:20965:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788643077.648876:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788643077.648877:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacfe792800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788643077.648886:0:20965:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788643077.648892:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacc835f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788643077.648895:0:20965:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacc835f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788643077.648901:0:20965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788643077.648987:0:20965:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788643077.648993:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3528 00000020:00000080:1.0:1788643077.648998:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cabc681a800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788643077.649021:0:20965:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788643077.649025:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788643077.649096:0:20965:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788643077.649101:0:20965:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9cabc7c399c0) has no exports 00000020:00000080:1.0:1788643077.649108:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3521 00000020:00000080:2.0:1788643077.649110:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc681a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788643077.649113:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacc835b800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788643077.649125:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacc835b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788643077.658402:0:20965:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788643077.658410:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788643077.658413:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788643077.658419:0:20965:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788643077.658464:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacc835e000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788643077.658465:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788643077.658475:0:20965:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788643077.658481:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacc8358800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788643077.658485:0:20965:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacc8358800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788643077.658491:0:20965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788643077.658632:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788643077.658635:0:20965:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788643077.658637:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacfe796800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788643077.658639:0:20965:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfe796800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788643077.658646:0:20965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788643077.658729:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c350c 00000020:00000080:1.0:1788643077.658736:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cabc7915000/lustre-MDD0001_UUID 00000020:01000000:1.0:1788643077.658741:0:20965:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788643077.658745:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788643077.658750:0:20965:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788643077.658753:0:20965:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9cabc7408000) has no exports 00000020:00000080:1.0:1788643077.658778:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788643077.658782:0:20965:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788643077.658786:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3513 00000020:00000080:1.0:1788643077.658790:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cabc7912000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788643077.658798:0:20965:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cabc681f000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788643077.658802:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7915000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788643077.658809:0:8:0:(genops.c:885:class_export_put()) final put ffff9cacd07cd000/lustre-MDD0001_UUID 00000020:01000004:1.0:1788643077.658811:0:20965:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cabc681f000 2 00000020:00000080:2.0:1788643077.658813:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacd07cd000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000004:1.0:1788643077.658817:0:20965:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cabc681f000 from lustre-MDT0001 00000020:01000000:2.0:1788643077.658820:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788643077.658834:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788643077.658837:0:20965:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788643077.658840:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacfe797800/lustre-MDT0001_UUID 00000020:00000080:1.0:1788643077.658841:0:20965:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfe797800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788643077.658847:0:20965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788643077.658885:0:20965:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788643077.658888:0:20965:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788643077.658890:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788643077.658893:0:20965:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788643077.658898:0:20965:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9cacd8150000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788643077.658902:0:20965:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9cacfdc899c0) has exports, disconnecting them 00000020:00080000:1.0:1788643077.658906:0:20965:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9cacd8150000), last request at 1788643007 00000020:00000080:1.0:1788643077.658909:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3591 00000020:00080000:1.0:1788643077.658919:0:20965:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cacd8150000): rc 0 00000020:00000080:1.0:1788643077.658922:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacd8150000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788643077.658979:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7912000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788643077.658988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacd8150000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788643077.664549:0:20965:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788643077.664558:0:20965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788643077.664563:0:20965:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788643077.664570:0:20965:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788643077.664693:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cacda401800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788643077.664785:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788643077.664794:0:20965:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788643077.664799:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacd8156000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788643077.664803:0:20965:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacd8156000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788643077.664809:0:20965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788643077.664882:0:20965:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cabc681f000 1 00000020:00000080:1.0:1788643077.664888:0:20965:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c34b8 00000020:00000080:1.0:1788643077.664895:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cacfe795800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788643077.664901:0:20965:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788643077.664915:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788643077.664919:0:20965:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788643077.664924:0:20965:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9cabc740cd40) has no exports 00000020:00000080:0.0:1788643077.664928:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfe795800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788643077.704046:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788643077.704058:0:20965:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788643077.704064:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cabc681d000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788643077.704069:0:20965:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc681d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788643077.704080:0:20965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788643077.704195:0:20965:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cabc681b000 00000020:01000000:1.0:1788643077.704292:0:20965:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788643077.704297:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788643077.704301:0:20965:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788643077.704304:0:20965:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9cabc7a399c0) has no exports 00000100:00100000:3.0:1788643077.704600:0:17194:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9cacd2e1a200:17194] 1 exiting: rc = 0 00000100:00100000:3.0:1788643077.704718:0:17195:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9cacd2e1aa00:17195] 2 exiting: rc = 0 00000100:00100000:2.0:1788643077.706126:0:17193:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9cace71cb000:17193] 0 exiting: rc = 1 00000100:00100000:0.0:1788643077.706609:0:20193:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9cabc7f3d600:20193] 3 exiting: rc = 0 00000100:00100000:3.0:1788643077.706957:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.706965:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.706971:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.706978:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.706983:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.706988:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.706994:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.706999:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707004:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707010:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707014:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707020:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707028:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707033:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707038:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707043:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707049:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707054:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707060:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707065:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707071:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707076:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707082:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707087:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707104:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707109:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707115:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707121:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707129:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707134:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707140:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707146:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707152:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707158:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707163:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707168:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707173:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707178:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707183:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707189:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707194:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707211:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707218:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707232:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707237:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707242:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707247:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707252:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707257:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707262:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707267:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707271:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707277:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707281:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707286:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707291:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707296:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707301:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707307:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707320:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707326:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707331:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707336:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.707349:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.710811:0:17196:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9cacd028d400:17196] 0 exiting: rc = 1 00000100:00100000:0.0:1788643077.710895:0:17197:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9caccb9ff600:17197] 1 exiting: rc = 0 00000100:00100000:3.0:1788643077.711045:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711052:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711060:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711065:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711071:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711076:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711082:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711086:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711091:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711096:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711100:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711105:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711110:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711116:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711122:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711127:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711131:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711137:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711142:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711147:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711153:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711158:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711164:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711169:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711174:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711179:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711184:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711189:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711195:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711200:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711238:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711244:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711248:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711253:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711257:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711262:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711266:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711271:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711275:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711280:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711285:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711290:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711295:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711301:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711306:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711311:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711316:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711322:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711327:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711333:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711338:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711343:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711348:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711352:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711357:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711373:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711404:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711413:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711418:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711423:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711428:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711432:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711437:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.711442:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.712232:0:17935:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9cacf5ec8e00:17935] 2 exiting: rc = 0 00000100:00100000:0.0:1788643077.712316:0:17199:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9caccb9ff000:17199] 1 exiting: rc = 0 00000100:00100000:0.0:1788643077.712408:0:17198:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9caccb9fec00:17198] 0 exiting: rc = 1 00000100:00100000:3.0:1788643077.712583:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712608:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712615:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712622:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712628:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712634:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712640:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712646:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712652:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712658:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712745:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712753:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712760:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712766:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712772:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712778:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712783:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712869:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712876:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712883:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712889:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712895:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712916:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712924:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712929:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712934:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712939:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712945:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712950:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712956:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712966:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712973:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712979:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.712985:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713008:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713015:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713031:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713036:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713042:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713048:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713053:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713059:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713065:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713070:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713076:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713082:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713102:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713108:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713113:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713119:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713125:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713131:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713138:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713144:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713152:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713159:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713166:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713171:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713192:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713199:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713633:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713639:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713645:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643077.713652:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788643077.731116:0:17200:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9cacfe7e4800:17200] 0 exiting: rc = 1 00000100:00100000:3.0:1788643077.731595:0:17201:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9cabc7b63c00:17201] 1 exiting: rc = 0 00000100:00100000:0.0:1788643077.731789:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731796:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731802:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731807:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731813:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731818:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731824:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731829:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731834:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731840:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731845:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731851:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731856:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731861:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731867:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731872:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731877:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731882:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731887:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731892:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731910:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731915:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731920:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731926:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731931:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731936:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731941:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731946:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731951:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731956:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731961:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731966:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731971:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731977:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731982:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731988:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731993:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.731999:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732004:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732010:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732015:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732020:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732025:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732031:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732035:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732040:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732045:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732050:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732056:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732061:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732066:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732072:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732077:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732082:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732087:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732099:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732104:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732110:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732116:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732121:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732127:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732132:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732137:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.732142:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733153:0:17203:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9cabc7b62e00:17203] 1 exiting: rc = 0 00000100:00100000:0.0:1788643077.733590:0:17202:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9cabc7b62a00:17202] 0 exiting: rc = 1 00000100:00100000:2.0:1788643077.733695:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733701:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733707:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733712:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733717:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733723:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733728:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733734:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733740:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733747:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733753:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733758:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733763:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733768:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733773:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733779:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733785:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733790:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733795:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733800:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733804:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733809:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733814:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733819:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733823:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733828:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733833:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733838:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733843:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733848:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733867:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733872:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733877:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733882:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733887:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733893:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733897:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733901:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733907:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733912:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733917:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733923:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733928:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733933:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733937:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733942:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733947:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733951:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733956:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733960:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733965:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733970:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733974:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733979:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733984:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733989:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.733994:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734000:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734005:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734010:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734015:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734019:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734024:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734029:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.734597:0:17204:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9cabc7b62200:17204] 0 exiting: rc = 1 00000100:00100000:3.0:1788643077.734722:0:17205:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9cacd1affa00:17205] 1 exiting: rc = 0 00000100:00100000:2.0:1788643077.734860:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734875:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734881:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734886:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734891:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734896:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734900:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734905:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734909:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734914:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734919:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734924:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734929:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734934:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734940:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734945:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734950:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734955:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734960:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734966:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734971:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734976:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734981:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734986:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734991:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.734997:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735002:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735007:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735012:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735016:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735021:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735025:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735029:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735034:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735039:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735044:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735057:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735061:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735066:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735071:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735075:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735080:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735086:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735091:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735096:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735101:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735106:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735112:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735117:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735122:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735127:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735132:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735137:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735142:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735146:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735151:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735157:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735162:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735167:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735173:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735180:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735185:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735190:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.735195:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643077.735818:0:17206:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9cacd1afe200:17206] 0 exiting: rc = 1 00000100:00100000:0.0:1788643077.735983:0:17208:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9cacc2d79200:17208] 2 exiting: rc = 0 00000100:00100000:3.0:1788643077.736368:0:17207:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9cacc3287200:17207] 1 exiting: rc = 0 00000100:00100000:2.0:1788643077.736489:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736497:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736511:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736533:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736540:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736545:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736550:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736567:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736573:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736578:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736584:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736591:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736597:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736603:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736608:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736613:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736619:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736625:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736631:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736637:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736642:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736648:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736654:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736722:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736731:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736736:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736742:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736763:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736770:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736776:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736782:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736788:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736793:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736799:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736805:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736812:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736818:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736824:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736831:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736838:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736845:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736851:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736866:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736872:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736877:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736883:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736889:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736894:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736900:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736906:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736913:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736935:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736942:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736948:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736954:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736959:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736964:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736970:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736975:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736981:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736986:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736991:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.736996:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643077.737001:0:20965:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788643077.747055:0:20965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643077.747067:0:20965:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788643077.747072:0:20965:0:(genops.c:885:class_export_put()) final put ffff9cace7165000/MDS_uuid 00000020:00000080:3.0:1788643077.747076:0:20965:0:(genops.c:844:class_export_destroy()) destroying export ffff9cace7165000/MDS_uuid for MDS 00000020:01000000:3.0:1788643077.747090:0:20965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788643077.747237:0:20965:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788643078.046195:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788643078.353087:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788643078.353098:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788643078.353101:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788643078.353105:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788643078.353110:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cabc7ce3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788643078.353117:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 554 00000100:00080000:2.0:1788643078.353122:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788643078.353129:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cabc7ce3800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643078.353176:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7455f80 x1875527696864896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788643078.353247:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788643078.353252:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788643078.353253:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cabc7980000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788643078.353256:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 554 00000100:00080000:2.0:1788643078.353259:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788643078.353263:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cabc7980000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643078.353275:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7456300 x1875527696865152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788643078.353323:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875527696864896:0@lo:38:kworker.0 00000400:00000100:2.0:1788643078.353373:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527696864896 offset 0 length 520: 4 00000100:00100000:2.0:1788643078.353416:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875527696865152:0@lo:38:kworker.0 00000400:00000100:2.0:1788643078.353434:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527696865152 offset 0 length 520: 4 00000100:00100000:2.0:1788643078.353462:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875527696865024:0@lo:400:kworker.0 00000400:00000100:2.0:1788643078.353480:0:3645:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527696865024 offset 0 length 224: 4 00000100:00100000:2.0:1788643078.353504:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875527696865280:0@lo:400:kworker.0 00000400:00000100:2.0:1788643078.353522:0:3642:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527696865280 offset 0 length 224: 4 00010000:00010000:0.0:1788643079.051669:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643080.075470:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643081.101738:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788643081.917929:0:21167:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788643081.932095:0:21167:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788643081.933701:0:21167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3de00/0x119ccc6e683c362b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3632 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643081.933788:0:21167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3de00/0x119ccc6e683c362b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3632 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643081.933799:0:21167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3de00/0x119ccc6e683c362b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3632 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643081.933806:0:21167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3de00/0x119ccc6e683c362b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3632 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643081.933827:0:21167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788643081.933832:0:21167:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788643081.933854:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788643081.933864:0:21167:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc7455f80 x1875527696864896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788643098 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643081.933918:0:21167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788643081.933924:0:21167:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1788643081.933927:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1788643081.933930:0:21167:0:(import.c:65:import_set_state_nolock()) ffff9cabc7ce3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1788643081.933933:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3de00/0x119ccc6e683c362b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3632 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788643081.933935:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788643081.933938:0:21167:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc7455f80 x1875527696864896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788643098 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788643081.933941:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3de00 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643081.933945:0:17182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3de00/0x119ccc6e683c362b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3632 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643081.933953:0:17182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3de00/0x119ccc6e683c362b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c3632 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643081.933960:0:17182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3de00/0x119ccc6e683c362b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c3632 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643081.933966:0:17182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788643081.933968:0:17182:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788643081.933970:0:17182:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788643081.933982:0:17182:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cace7162000 00010000:00010000:0.0:1788643081.933998:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3de00/0x119ccc6e683c362b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c3632 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643081.934004:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3de00/0x119ccc6e683c362b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c3632 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643081.934017:0:21167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00010000:00010000:0.0:1788643081.934017:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643081.934019:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643081.934021:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643081.934039:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875527696864896:0@lo:38:kworker.0 00000100:00100000:3.0:1788643081.934078:0:21167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788643081.936043:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788643081.936057:0:21167:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc7455c00 x1875527696865024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643094 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643081.936134:0:21167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788643081.936139:0:21167:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788643081.936160:0:21167:0:(import.c:65:import_set_state_nolock()) ffff9cabc7ce6800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788643081.936316:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875527696865024:0@lo:400:kworker.0 00000100:00100000:0.0:1788643081.937146:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1875527696865408:0@lo:39:umount.0 00000400:00000100:0.0:1788643081.937194:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527696865408 offset 0 length 224: 4 00010000:00010000:2.0:1788643082.125820:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788643082.379581:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788643082.379591:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788643082.379594:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788643082.379597:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788643082.379760:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875527696865536:0@lo:400:kworker.0 00000400:00000100:0.0:1788643082.379817:0:3643:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527696865536 offset 0 length 224: 4 00000001:00100000:1.0:1788643082.960920:0:19514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788643082.960929:0:19514:0:(genops.c:885:class_export_put()) final put ffff9cabc10e0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788643082.961140:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc10e0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788643082.961204:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc10e3800 for lustre-OST0001 00000001:00100000:0.0:1788643082.963099:0:18698:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788643082.963107:0:18698:0:(genops.c:885:class_export_put()) final put ffff9cabc7986000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788643082.963202:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7986000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788643082.963243:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc7983800 for lustre-OST0000 00010000:00010000:2.0:1788643083.148006:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788643083.403555:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788643083.403564:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788643083.403568:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788643083.403572:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788643083.403826:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875527696865664:0@lo:400:kworker.0 00000400:00000100:1.0:1788643083.403878:0:3644:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527696865664 offset 0 length 224: 4 00010000:00010000:0.0:1788643084.172589:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643085.195531:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643086.219629:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643087.051506:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643077/real 1788643077] req@ffff9cabc7454a80 x1875527696864768/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788643087 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643087.051538:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cabc7454a80 x1875527696864768/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788643087 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788643087.051556:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cace7162000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788643087.051587:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788643087.051591:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01073fa7-a753-425c-8af1-85d79a3a8f8c:3641:1875527696864768:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1788643087.051983:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788643087.051989:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788643087.051992:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cace7162000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788643087.052006:0:36:0:(import.c:545:import_select_connection()) MGC192.168.206.118@tcp: connect to NID 0@lo last attempt 558 00000100:00080000:3.0:1788643087.052011:0:36:0:(import.c:630:import_select_connection()) MGC192.168.206.118@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788643087.052017:0:36:0:(import.c:665:import_select_connection()) MGC192.168.206.118@tcp: import ffff9cace7162000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788643087.052047:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc88eb800 x1875527696865792/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788643087.052075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788643087.052079:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788643087.052229:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788643087.052245:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875527696865920:0@lo:400:kworker.0 00000100:00100000:2.0:1788643087.052250:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01073fa7-a753-425c-8af1-85d79a3a8f8c:3641:1875527696865792:0@lo:250:kworker.0 00000400:00000100:1.0:1788643087.055192:0:3644:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527696865920 offset 0 length 224: 4 00000400:00000100:2.0:1788643087.055971:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875527696865792 offset 0 length 520: 4 00010000:00010000:0.0:1788643087.245362:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643088.267528:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643089.293881:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643090.316305:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643091.147505:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643081/real 1788643081] req@ffff9cacc88e8e00 x1875527696865408/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788643091 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643091.147536:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cacc88e8e00 x1875527696865408/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788643091 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788643091.147575:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc7ce6800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788643091.147599:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1875527696865408:0@lo:39:umount.0 00000100:00080000:3.0:1788643091.147724:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788643091.147728:0:21167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788643091.147739:0:21167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788643091.148908:0:21167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7494600/0x119ccc6e683c3601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3608 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643091.148924:0:21167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7494600/0x119ccc6e683c3601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3608 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643091.148932:0:21167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7494600/0x119ccc6e683c3601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3608 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643091.148938:0:21167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cabc7494600/0x119ccc6e683c3601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3608 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643091.149016:0:21167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788643091.149025:0:21167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3957 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c395e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643091.149032:0:21167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3957 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c395e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643091.149038:0:21167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3957 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c395e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643091.149044:0:21167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3957 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c395e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643091.149796:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788643091.149805:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cabc7494600/0x119ccc6e683c3601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3608 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643091.149815:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494600 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:2.0:1788643091.149819:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cabc7494600/0x119ccc6e683c3601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3608 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643091.149828:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cabc7494600/0x119ccc6e683c3601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c3608 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788643091.149836:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cabc7494600/0x119ccc6e683c3601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c3608 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643091.149842:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788643091.149844:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788643091.149856:0:17181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cace7162000 00010000:00010000:2.0:1788643091.149859:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cabc7494600/0x119ccc6e683c3601 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c3608 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643091.149866:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cabc7494600/0x119ccc6e683c3601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c3608 expref: -99 pid: 18697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643091.149881:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643091.149884:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c395e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643091.149904:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc2811200 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:2.0:1788643091.149907:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c395e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643091.149914:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3957 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c395e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788643091.149920:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3957 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c395e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643091.149924:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788643091.149926:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788643091.149931:0:17181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cace7162000 00010000:00010000:2.0:1788643091.149934:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3957 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c395e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643091.149942:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643091.149943:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643091.149945:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643091.150475:0:21167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788643091.150481:0:21167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3957 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c395e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643091.150492:0:21167:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788643091.150504:0:21167:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788643091.150506:0:21167:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788643091.150541:0:21167:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788643091.150545:0:21167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788643091.150550:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643091.150555:0:21167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788643091.150559:0:21167:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9cacfdc8b380) has no exports 00000020:00080000:3.0:1788643091.150583:0:21167:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9cacfdc8b380) has no exports 00000020:01000000:3.0:1788643091.152226:0:21167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cacfe4ef3c0 - data ffff9cace7dae510/ffff9cacfcf62800 00010000:00010000:2.0:1788643091.152246:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788643091.152378:0:21167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cacfe62cae0 - data ffff9cace7f2fbd0/ffff9cacc8cbd000 00100000:10000000:2.0:1788643091.161525:0:21167:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788643091.169923:0:21167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3616 00000020:00000080:3.0:1788643091.169934:0:21167:0:(genops.c:885:class_export_put()) final put ffff9cacfe794000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788643091.169958:0:21167:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cabc7fc6800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788643091.169963:0:21167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cabc7fc6800 2 00000020:01000004:3.0:1788643091.169966:0:21167:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cabc7fc6800 from lustre-OST0000 00000020:00000080:3.0:1788643091.169996:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643091.170005:0:21167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788643091.170008:0:21167:0:(genops.c:885:class_export_put()) final put ffff9cacfe791800/lustre-OST0000_UUID 00000020:00000080:3.0:1788643091.170011:0:21167:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfe791800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788643091.170017:0:21167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788643091.170072:0:21167:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788643091.170076:0:21167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788643091.170081:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643091.170085:0:21167:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788643091.170092:0:21167:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9cabc7ce3000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788643091.170098:0:21167:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9cacf5738000) has exports, disconnecting them 00000020:00080000:3.0:1788643091.170102:0:21167:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9cabc7ce3000), last request at 1788643019 00000020:00000080:3.0:1788643091.170106:0:21167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3640 00000020:00080000:3.0:1788643091.170115:0:21167:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cabc7ce3000): rc 0 00000020:00000080:3.0:1788643091.170119:0:21167:0:(genops.c:885:class_export_put()) final put ffff9cabc7ce3000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788643091.170807:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacfe794000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788643091.170819:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7ce3000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788643091.176590:0:21167:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788643091.176601:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788643091.176605:0:21167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788643091.176613:0:21167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788643091.176830:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788643091.176839:0:21167:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788643091.176847:0:21167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788643091.176854:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788643091.176866:0:21167:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788643091.176874:0:21167:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9cabc7ce1800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788643091.176880:0:21167:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9cacf57399c0) has exports, disconnecting them 00000020:00080000:0.0:1788643091.176884:0:21167:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9cabc7ce1800), last request at 1788643019 00000020:00000080:0.0:1788643091.176888:0:21167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3655 00000020:00080000:0.0:1788643091.176903:0:21167:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cabc7ce1800): rc 0 00000020:00000080:0.0:1788643091.176908:0:21167:0:(genops.c:885:class_export_put()) final put ffff9cabc7ce1800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788643091.177553:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc7ce3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788643091.177562:0:36:0:(genops.c:885:class_export_put()) final put ffff9cabc7ce7800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788643091.177565:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7ce7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788643091.177576:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788643091.177639:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7ce1800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788643091.177659:0:21167:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788643091.177662:0:21167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788643091.177671:0:21167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788643091.177674:0:21167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788643091.177688:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc7ce6800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788643091.177799:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788643091.177804:0:21167:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788643091.177807:0:21167:0:(genops.c:885:class_export_put()) final put ffff9cabc7ce2000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788643091.177809:0:21167:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7ce2000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788643091.177812:0:21167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788643091.177840:0:21167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cabc7fc6800 1 00000020:00000080:1.0:1788643091.177844:0:21167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c35f3 00000020:00000080:1.0:1788643091.177848:0:21167:0:(genops.c:885:class_export_put()) final put ffff9cacf7e57000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788643091.177855:0:21167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788643091.177861:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacf7e57000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788643091.177868:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788643091.177871:0:21167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788643091.177873:0:21167:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9cacf6cf4d40) has no exports 00000020:00000080:3.0:1788643091.262757:0:21167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643091.262770:0:21167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788643091.262789:0:21167:0:(genops.c:885:class_export_put()) final put ffff9cabc7fc5000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788643091.262793:0:21167:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7fc5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788643091.262803:0:21167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788643091.262939:0:21167:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cabc7fc4000 00000020:02000400:3.0:1788643091.263064:0:21167:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788643091.341523:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788643092.189014:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788643092.189025:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788643092.189028:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788643092.189031:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788643092.189177:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875527696866048:0@lo:400:kworker.0 00000400:00000100:3.0:1788643092.189230:0:3642:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527696866048 offset 0 length 224: 4 00010000:00010000:2.0:1788643092.363454:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643093.387503:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788643094.283830:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643078/real 1788643078] req@ffff9cabc7455880 x1875527696865280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788643094 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643094.320830:0:3642:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9cabc7455880 x1875527696865280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788643094 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788643094.320844:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9cabc7981000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788643094.320848:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788643094.338507:0:3642:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1788643094.338577:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788643094.338583:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788643094.338586:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788643094.338589:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788643094.338592:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788643094.338595:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788643094.338598:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cabc7981000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788643094.338605:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 513 00000100:00080000:2.0:1788643094.338614:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9cabc7981000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643094.338661:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7455f80 x1875527696866176/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788643094.339032:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875527696865280:0@lo:400:kworker.0 00000100:00100000:1.0:1788643094.339216:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1875527696866176:0@lo:38:kworker.0 00000400:00000100:1.0:1788643094.339265:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527696866176 offset 0 length 520: 4 00010000:00010000:0.0:1788643094.412719:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788643094.897764:0:21368:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788643094.909379:0:21368:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788643094.909472:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3790 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.909486:0:21368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3790 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.909493:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3790 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.909500:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3790 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.909518:0:21368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788643094.909523:0:21368:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788643094.909550:0:21368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788643094.909562:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc7456300 x1875527696865152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788643098 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643094.909577:0:21368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788643094.909583:0:21368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788643094.909589:0:21368:0:(import.c:65:import_set_state_nolock()) ffff9cabc7980000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788643094.909608:0:21368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788643094.909612:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc7456300 x1875527696865152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788643098 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643094.909633:0:21368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788643094.909637:0:21368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:3.0:1788643094.909664:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788643094.909670:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3790 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.909676:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3d200 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:3.0:1788643094.909679:0:17181:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3790 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643094.910040:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875527696865152:0@lo:38:kworker.0 00010000:00010000:3.0:1788643094.910157:0:17181:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c3790 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788643094.910164:0:17181:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c3790 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643094.910168:0:17181:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788643094.910171:0:17181:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788643094.910173:0:17181:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788643094.910186:0:17181:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cace7162000 00010000:00010000:3.0:1788643094.910190:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3789 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c3790 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.910197:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c3790 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.910208:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643094.910216:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643094.910218:0:17181:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788643094.911049:0:21368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788643094.911410:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cacc88e8000 x1875527696865536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643098 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643094.911441:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc7455c00 x1875527696865664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643099 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643094.911454:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cacc88e9500 x1875527696865920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643103 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643094.911461:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc7454a80 x1875527696866048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643108 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643094.911474:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc7455f80 x1875527696866176/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788643104 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643094.911484:0:21368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788643094.911516:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875527696866048:0@lo:400:kworker.0 00000100:00080000:3.0:1788643094.911541:0:21368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788643094.911546:0:21368:0:(import.c:65:import_set_state_nolock()) ffff9cabc7981000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788643094.911551:0:21368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788643094.911555:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cacc88e8000 x1875527696865536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643098 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643094.911563:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc7455c00 x1875527696865664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643099 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643094.911570:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cacc88e9500 x1875527696865920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643103 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643094.911576:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cabc7455f80 x1875527696866176/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788643104 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643094.911583:0:21368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788643094.911595:0:21368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:1.0:1788643094.915150:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875527696865536:0@lo:400:kworker.0 00000100:00100000:1.0:1788643094.915225:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875527696865920:0@lo:400:kworker.0 00000100:00100000:1.0:1788643094.915232:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875527696865664:0@lo:400:kworker.0 00000100:00100000:1.0:1788643094.915255:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1875527696866176:0@lo:38:kworker.0 00010000:00010000:3.0:1788643094.919433:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3dc00/0x119ccc6e683c375f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3766 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.919452:0:21368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3dc00/0x119ccc6e683c375f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3766 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.919459:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3dc00/0x119ccc6e683c375f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3766 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.919466:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3dc00/0x119ccc6e683c375f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3766 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.919493:0:21368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788643094.919501:0:21368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811a00/0x119ccc6e683c3949 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3950 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.919508:0:21368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811a00/0x119ccc6e683c3949 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3950 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.919514:0:21368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811a00/0x119ccc6e683c3949 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3950 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.919519:0:21368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.118@tcp lock: ffff9cacc2811a00/0x119ccc6e683c3949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x119ccc6e683c3950 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643094.919529:0:21368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788643094.920113:0:17950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788643094.920122:0:17950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3dc00/0x119ccc6e683c375f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3766 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643094.920146:0:17950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3dc00 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643094.920150:0:17950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3dc00/0x119ccc6e683c375f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3766 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643094.920159:0:17950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3dc00/0x119ccc6e683c375f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c3766 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643094.920167:0:17950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3dc00/0x119ccc6e683c375f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c3766 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643094.920172:0:17950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788643094.920175:0:17950:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788643094.920186:0:17950:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cace7162000 00010000:00010000:0.0:1788643094.920189:0:17950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3dc00/0x119ccc6e683c375f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c3766 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643094.920195:0:17950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3dc00/0x119ccc6e683c375f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c3766 expref: -99 pid: 19513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643094.920234:0:17950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643094.920238:0:17950:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacc2811a00/0x119ccc6e683c3949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3950 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643094.920243:0:17950:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc2811a00 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643094.920246:0:17950:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacc2811a00/0x119ccc6e683c3949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x119ccc6e683c3950 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643094.920252:0:17950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc2811a00/0x119ccc6e683c3949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c3950 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643094.920259:0:17950:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc2811a00/0x119ccc6e683c3949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c3950 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643094.920264:0:17950:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788643094.920266:0:17950:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788643094.920279:0:17950:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cace7162000 00010000:00010000:0.0:1788643094.920282:0:17950:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacc2811a00/0x119ccc6e683c3949 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c3950 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643094.920288:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643094.920290:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643094.920291:0:17950:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643094.920300:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643094.920561:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc2811a00/0x119ccc6e683c3949 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c3950 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643094.920576:0:21368:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788643094.920588:0:21368:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788643094.920591:0:21368:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788643094.920629:0:21368:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788643094.920633:0:21368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788643094.920638:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643094.920643:0:21368:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788643094.920647:0:21368:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9cacc8808000) has no exports 00000020:00080000:3.0:1788643094.920670:0:21368:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9cacc8808000) has no exports 00000020:01000000:3.0:1788643094.922255:0:21368:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cacfe4efa20 - data ffff9cace7dbb510/ffff9cacfcf12c00 00000020:01000000:3.0:1788643094.923037:0:21368:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cacfe4ef360 - data ffff9cace7f2f360/ffff9cacfcf63000 00100000:10000000:3.0:1788643094.931830:0:21368:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788643094.957523:0:21368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3774 00000020:00000080:0.0:1788643094.957534:0:21368:0:(genops.c:885:class_export_put()) final put ffff9cabc10e4800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788643094.957550:0:21368:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cabc7ce5000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788643094.957553:0:21368:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cabc7ce5000 2 00000020:01000004:0.0:1788643094.957556:0:21368:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cabc7ce5000 from lustre-OST0001 00000020:00000080:0.0:1788643094.957591:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788643094.957601:0:21368:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788643094.957604:0:21368:0:(genops.c:885:class_export_put()) final put ffff9cabc10e5000/lustre-OST0001_UUID 00000020:00000080:0.0:1788643094.957608:0:21368:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc10e5000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788643094.957615:0:21368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788643094.957716:0:21368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 01073fa7-a753-425c-8af1-85d79a3a8f8c->MGS 00010000:00010000:0.0:1788643094.957732:0:21368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cad02175a00/0x119ccc6e683c34bf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c34c6 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643094.957744:0:21368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cad02175a00/0x119ccc6e683c34bf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c34c6 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643094.957750:0:21368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788643094.957752:0:21368:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788643094.957755:0:21368:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788643094.957768:0:21368:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cace7162000 00010000:00010000:0.0:1788643094.957772:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cad02175a00/0x119ccc6e683c34bf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c34c6 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643094.957788:0:21368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc13aa000/0x119ccc6e683c33ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x119ccc6e683c33b5 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643094.957795:0:21368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc13aa000/0x119ccc6e683c33ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x119ccc6e683c33b5 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643094.957801:0:21368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788643094.957803:0:21368:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788643094.957805:0:21368:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788643094.957814:0:21368:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cace7162000 00010000:00010000:0.0:1788643094.957816:0:21368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc13aa000/0x119ccc6e683c33ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x119ccc6e683c33b5 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788643094.957844:0:21368:0:(import.c:65:import_set_state_nolock()) ffff9cace7162000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788643094.957849:0:21368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788643094.957852:0:21368:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788643094.957853:0:21368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788643094.957857:0:21368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788643094.957868:0:21368:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cacc88eb800 x1875527696865792/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788643102 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788643094.957882:0:21368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788643094.957885:0:21368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000020:00000080:1.0:1788643094.958603:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc10e4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1788643094.965002:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01073fa7-a753-425c-8af1-85d79a3a8f8c:3641:1875527696865792:0@lo:250:kworker.0 10000000:01000000:0.0:1788643094.965230:0:21368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788643094.965247:0:21368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3399 00000020:00000080:0.0:1788643094.965257:0:21368:0:(genops.c:885:class_export_put()) final put ffff9cace7167800/01073fa7-a753-425c-8af1-85d79a3a8f8c 00000020:01000000:0.0:1788643094.965280:0:21368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.118@tcp (flags='') 00000020:00000080:0.0:1788643094.965287:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788643094.965294:0:21368:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.118@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788643094.965298:0:21368:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9cabc7a3cd40) has no exports 00000020:00000080:1.0:1788643094.965417:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cace7167800/01073fa7-a753-425c-8af1-85d79a3a8f8c for MGC192.168.206.118@tcp 10000000:01000000:2.0:1788643094.965513:0:17190:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788643094.965640:0:21368:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.118@tcp: client import never connected 00000100:00080000:0.0:1788643094.965644:0:21368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788643094.965647:0:21368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788643094.965650:0:21368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788643094.965652:0:21368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788643094.965747:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788643094.965755:0:21368:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.118@tcp (uuid 01073fa7-a753-425c-8af1-85d79a3a8f8c) 00000020:01000000:0.0:1788643094.965776:0:21368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788643094.965779:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788643094.965784:0:21368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788643094.965789:0:21368:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9cabc7981800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788643094.965794:0:21368:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9cacf6cf3380) has exports, disconnecting them 00000020:00080000:0.0:1788643094.965798:0:21368:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9cabc7981800), last request at 1788643032 00000020:00000080:0.0:1788643094.965802:0:21368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c379e 00000020:00080000:0.0:1788643094.965823:0:21368:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cabc7981800): rc 0 00000020:00000080:0.0:1788643094.965828:0:21368:0:(genops.c:885:class_export_put()) final put ffff9cabc7981800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788643094.972756:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cace7162000 for MGC192.168.206.118@tcp 00000020:00000080:1.0:1788643094.972772:0:8:0:(genops.c:885:class_export_put()) final put ffff9cace7160800/01073fa7-a753-425c-8af1-85d79a3a8f8c 00000020:00000080:1.0:1788643094.972775:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cace7160800/01073fa7-a753-425c-8af1-85d79a3a8f8c for MGC192.168.206.118@tcp 00000020:01000000:1.0:1788643094.972783:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.118@tcp (01073fa7-a753-425c-8af1-85d79a3a8f8c) 00000020:00000080:1.0:1788643094.977186:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7981800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788643094.984530:0:21368:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788643094.984538:0:21368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788643094.984542:0:21368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788643094.984549:0:21368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788643094.984642:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc7980000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788643094.984757:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788643094.984776:0:21368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788643094.984783:0:21368:0:(genops.c:885:class_export_put()) final put ffff9cabc1c84000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788643094.984786:0:21368:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc1c84000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788643094.984798:0:21368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788643094.985753:0:21368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788643094.985760:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788643094.985774:0:21368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788643094.985783:0:21368:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9cabc7980800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788643094.985789:0:21368:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9cacf6cf19c0) has exports, disconnecting them 00000020:00080000:1.0:1788643094.985795:0:21368:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9cabc7980800), last request at 1788643032 00000020:00000080:1.0:1788643094.985811:0:21368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c37b3 00000020:00080000:1.0:1788643094.985829:0:21368:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cabc7980800): rc 0 00000020:00000080:1.0:1788643094.985834:0:21368:0:(genops.c:885:class_export_put()) final put ffff9cabc7980800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788643094.986163:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7980800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788643094.990937:0:21368:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788643094.990945:0:21368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788643094.990950:0:21368:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788643094.990957:0:21368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788643094.990988:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cabc7981000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788643094.993363:0:17181:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788643094.994437:0:17950:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788643094.998648:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788643094.998793:0:17176:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9cabc7499400:17176] 0 exiting: rc = 1 00000100:00100000:2.0:1788643094.998846:0:17177:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9cacefdbe200:17177] 1 exiting: rc = 0 00000100:00100000:2.0:1788643094.998905:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.001504:0:17180:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9cacc8529600:17180] 2 exiting: rc = 0 00000100:00100000:1.0:1788643095.044641:0:17179:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9cacefdbf600:17179] 1 exiting: rc = 0 00000100:00100000:1.0:1788643095.044792:0:17178:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9cacefdbe600:17178] 0 exiting: rc = 1 00000100:00100000:2.0:1788643095.045039:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045048:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045054:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045062:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045067:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045073:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045080:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045085:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045090:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045095:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045100:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045105:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045110:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045114:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045119:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045124:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045135:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045141:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045146:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045151:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045156:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045161:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045166:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045171:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045176:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045181:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045186:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045191:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045196:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045200:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045205:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045209:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045214:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045219:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045237:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045242:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045248:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045253:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045257:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045263:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045268:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045272:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045277:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045281:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045286:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045290:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045294:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045299:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045304:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045308:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045313:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045318:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045322:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045327:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045332:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045337:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045342:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045346:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045351:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045356:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045360:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045365:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045369:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.045374:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788643095.046631:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788643095.046641:0:21368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788643095.046646:0:21368:0:(genops.c:885:class_export_put()) final put ffff9cabc7986800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788643095.046650:0:21368:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7986800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788643095.046657:0:21368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788643095.046706:0:21368:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cabc7ce5000 1 00000020:00000080:3.0:1788643095.046711:0:21368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x119ccc6e683c3758 00000020:00000080:3.0:1788643095.046716:0:21368:0:(genops.c:885:class_export_put()) final put ffff9cabc783e800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788643095.046735:0:21368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788643095.046739:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788643095.046744:0:21368:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788643095.046747:0:21368:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9cacc880cd40) has no exports 00000020:00000080:2.0:1788643095.047037:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc783e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788643095.093658:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788643095.093670:0:21368:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788643095.093675:0:21368:0:(genops.c:885:class_export_put()) final put ffff9cabc7ce1000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788643095.093679:0:21368:0:(genops.c:844:class_export_destroy()) destroying export ffff9cabc7ce1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788643095.093700:0:21368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788643095.094029:0:21368:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cabc7ce4000 00000020:01000000:2.0:1788643095.094056:0:21368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788643095.094060:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788643095.094064:0:21368:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788643095.094068:0:21368:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9cacda7f0000) has no exports 00000020:00000080:2.0:1788643095.094087:0:21368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788643095.094092:0:21368:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788643095.094095:0:21368:0:(genops.c:885:class_export_put()) final put ffff9cacf7e53800/OSS_uuid 00000020:00000080:2.0:1788643095.094097:0:21368:0:(genops.c:844:class_export_destroy()) destroying export ffff9cacf7e53800/OSS_uuid for OSS 00000020:01000000:2.0:1788643095.094100:0:21368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788643095.094218:0:18701:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9cacc7bbe600:18701] 0 exiting: rc = 1 00000100:00100000:1.0:1788643095.094228:0:18702:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9cacc7bbfc00:18702] 1 exiting: rc = 0 00000100:00100000:3.0:1788643095.094240:0:19890:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9cabc6bf2600:19890] 3 exiting: rc = 0 00000100:00080000:0.0:1788643095.094300:0:17189:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788643095.098826:0:18704:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9cabc7cf5c00:18704] 2 exiting: rc = 0 00000100:00100000:2.0:1788643095.098966:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.098988:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.098995:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099000:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099005:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099010:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099015:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099020:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099026:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099031:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099035:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099552:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099560:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099567:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099572:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099578:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099583:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099589:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099594:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099600:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099606:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099625:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099631:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099637:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099642:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099647:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099653:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099669:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099676:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099681:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099686:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099692:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099697:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099703:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099708:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099714:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099719:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099724:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099729:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099735:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099740:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099746:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099751:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099756:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099762:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099767:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099772:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099777:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099783:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099788:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099793:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099799:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099804:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099810:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099815:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099820:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099832:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099837:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.099843:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.100213:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.100225:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.100231:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.100236:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.100242:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.101499:0:18706:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9caccc730a00:18706] 1 exiting: rc = 0 00000100:00100000:1.0:1788643095.102408:0:19992:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9cabc6804000:19992] 2 exiting: rc = 0 00000100:00100000:1.0:1788643095.102484:0:18705:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9cabc7d98200:18705] 0 exiting: rc = 1 00000100:00100000:2.0:1788643095.104433:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104443:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104448:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104454:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104459:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104464:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104469:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104474:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104478:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104483:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104492:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104497:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104502:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104507:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104513:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104518:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104522:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104527:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104533:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104538:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104544:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104549:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104554:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104560:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104565:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104571:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104594:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104600:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104606:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104611:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104616:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104621:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104626:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104630:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104635:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104640:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104645:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104651:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104656:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104661:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104667:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104672:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104678:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104685:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104690:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104696:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104702:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104707:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104712:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104717:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104723:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104729:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104734:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104739:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104745:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104750:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104756:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104762:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104769:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104775:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104782:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104796:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104802:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.104808:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788643095.107481:0:18709:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9cabc5e01e00:18709] 2 exiting: rc = 0 00000100:00100000:0.0:1788643095.108138:0:20333:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9cabc5fb2000:20333] 3 exiting: rc = 0 00000100:00100000:0.0:1788643095.108352:0:18707:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9cacfdc3f400:18707] 0 exiting: rc = 1 00000100:00100000:2.0:1788643095.109032:0:18708:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9cace71ea600:18708] 1 exiting: rc = 0 00000100:00100000:2.0:1788643095.109117:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109127:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109146:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109152:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109158:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109164:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109170:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109176:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109182:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109188:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109194:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109200:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109206:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109211:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109218:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109224:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109230:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109235:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109260:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109268:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109273:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109278:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109283:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109289:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109294:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109299:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109306:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109311:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109317:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109322:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109329:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109349:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109355:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109362:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109369:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109375:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109408:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109415:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109421:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109428:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109434:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109441:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109462:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109470:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109475:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109480:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109486:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109491:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109497:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109502:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109509:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109515:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109521:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109527:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109533:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109540:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109546:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109553:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109568:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109575:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109581:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109588:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109595:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788643095.109601:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788643095.120774:0:18710:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9cacfdddc800:18710] 0 exiting: rc = 1 00000100:00100000:2.0:1788643095.121324:0:18711:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9cacfdc7c200:18711] 1 exiting: rc = 0 00000100:00100000:3.0:1788643095.121675:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121682:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121687:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121692:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121697:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121712:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121717:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121722:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121727:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121732:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121737:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121742:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121769:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121775:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121780:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121785:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121790:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121795:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121800:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121806:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121811:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121815:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121820:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121825:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121829:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121834:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121839:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121844:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121849:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121853:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121858:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121863:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121867:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121872:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121876:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121881:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121886:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121890:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121894:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121899:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121907:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121912:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121917:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121922:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121930:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121936:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121941:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121946:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121951:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121956:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121963:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121972:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121977:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121983:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121988:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121992:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.121997:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.122002:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.122007:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.122012:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.122018:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.122023:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.122028:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.122033:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788643095.123057:0:18713:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9cabc5dc4e00:18713] 1 exiting: rc = 0 00000100:00100000:2.0:1788643095.125533:0:18712:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9cacfe426600:18712] 0 exiting: rc = 1 00000100:00100000:3.0:1788643095.125742:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125750:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125758:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125764:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125771:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125777:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125785:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125791:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125797:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125806:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125832:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125845:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125851:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125858:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125865:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125871:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125877:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125884:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125890:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125896:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125903:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125909:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125929:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125935:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125941:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125947:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125954:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125960:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125966:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125972:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125979:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125986:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125992:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.125998:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126018:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126025:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126033:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126040:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126047:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126053:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126059:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126067:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126075:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126081:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126087:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126093:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126118:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126124:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126145:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126153:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126161:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126168:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126174:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126181:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126188:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126194:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126200:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126207:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126227:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126235:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126241:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126247:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126254:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788643095.126266:0:21368:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788643095.147439:0:21368:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788643112.887514:0:22132:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788643121.163314:0:22731:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788643121.163320:0:22731:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788643121.163322:0:22731:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788643121.163715:0:22731:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cabc94a4800 00000020:01000004:2.0:1788643121.163731:0:22731:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788643121.163739:0:22731:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788643121.163753:0:22731:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9cacf6cf0000) 00000020:00000080:2.0:1788643121.163765:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788643121.216503:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.216858:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788643121.217454:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788643121.218481:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788643121.218716:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788643121.221373:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788643121.221849:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788643121.222261:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788643121.222529:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788643121.222713:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788643121.222903:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788643121.223195:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788643121.223461:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788643121.223704:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788643121.223894:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788643121.226428:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.228217:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.228675:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.228891:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.229233:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.229522:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.229727:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.229924:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.230279:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.230644:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.230901:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.231212:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.231527:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.231908:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.233076:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.233330:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.233641:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.233845:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.234063:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.234318:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.234817:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.235256:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.236114:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.236723:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.236998:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.237255:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.237583:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.238210:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.238508:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.238783:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788643121.239041:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.239309:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788643121.240956:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788643121.241634:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788643121.242544:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788643121.243747:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788643121.244098:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788643121.244342:0:22731:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:3.0:1788643121.244852:0:22731:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788643121.245184:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788643121.245192:0:22731:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788643121.245203:0:22731:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x119ccc6e683c3c0c 00000020:01000004:3.0:1788643121.245209:0:22731:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788643121.245214:0:22731:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788643121.245218:0:22731:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cabc94a4800 from MGS 00000020:01000004:3.0:1788643121.245222:0:22731:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788643121.245231:0:22731:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9cacc880b380) 00000020:00000080:3.0:1788643121.245250:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788643121.245314:0:22731:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cabc94a4800 from MGS, refs=2 00080000:01000000:3.0:1788643121.245319:0:22731:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788643121.245324:0:22731:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x119ccc6e683c3c1a 00000100:00100000:3.0:1788643121.245549:0:22731:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788643121.245672:0:22731:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788643121.245678:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788643121.246217:0:22731:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788643121.246225:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788643121.247124:0:22731:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788643121.247278:0:22731:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788643121.247283:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788643121.247786:0:22731:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788643121.247793:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788643121.248316:0:22731:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788643121.248322:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788643121.249142:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643121.249146:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643121.249148:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643121.251894:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643121.251900:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643121.251904:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643121.254501:0:22731:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788643121.255646:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788643121.259596:0:22731:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788643121.260651:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788643121.260704:0:22731:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788643121.260741:0:22731:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788643121.261338:0:22731:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788643121.261690:0:22731:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788643121.261831:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788643121.261837:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788643121.262802:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788643121.262812:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788643121.263172:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788643121.263178:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788643121.270756:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788643121.270785:0:22731:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.118@tcp' 00000020:01000004:0.0:1788643121.270788:0:22731:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788643121.270830:0:22731:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.118@tcp (typ=mgc) 00000020:00000080:0.0:1788643121.270844:0:22731:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.118@tcp (ffff9cacfdc88000) 00000020:00000080:0.0:1788643121.270863:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788643121.270997:0:22731:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cabc9388800@MGC192.168.206.118@tcp: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788643121.271196:0:22731:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.118@tcp-0 is initialized 00000040:01000000:0.0:1788643121.271201:0:22731:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788643121.271340:0:22748:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788643121.273803:0:22749:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788643121.273934:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.118@tcp (uuid da540a41-a984-4ac4-89dc-6d833e36a776) 00000020:00000080:3.0:1788643121.273962:0:22731:0:(genops.c:1385:class_connect()) connect: client da540a41-a984-4ac4-89dc-6d833e36a776, cookie 0x119ccc6e683c3c28 00000100:00080000:3.0:1788643121.280215:0:22731:0:(import.c:545:import_select_connection()) MGC192.168.206.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788643121.280226:0:22731:0:(import.c:665:import_select_connection()) MGC192.168.206.118@tcp: import ffff9cabc9388800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788643121.280266:0:22731:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc88e9c00 x1875527696866304/t0(0) o250->MGC192.168.206.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788643121.280292:0:22731:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import da540a41-a984-4ac4-89dc-6d833e36a776->MGS 00000020:01000004:3.0:1788643121.280313:0:22731:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788643121.280342:0:22731:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788643121.280367:0:22731:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9cacc88099c0) 00000020:00000080:3.0:1788643121.280407:0:22731:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788643121.281204:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da540a41-a984-4ac4-89dc-6d833e36a776:3641:1875527696866304:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788643121.281270:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643121.281341:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696866304 00000100:00100000:2.0:1788643121.281347:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696866304 00000100:00100000:2.0:1788643121.281377:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788643121.281399:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3641:x1875527696866304:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788643121.281421:0:22744:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from da540a41-a984-4ac4-89dc-6d833e36a776@0@lo t0 exp 0000000000000000 cur 602 last 0 00000020:00000080:2.0:1788643121.281443:0:22744:0:(genops.c:1385:class_connect()) connect: client da540a41-a984-4ac4-89dc-6d833e36a776, cookie 0x119ccc6e683c3c36 00000100:00080000:2.0:1788643121.281555:0:22744:0:(import.c:65:import_set_state_nolock()) ffff9cabc9461800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788643121.281604:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+5:3641:x1875527696866304:12345-0@lo:250:mount.lustre.0 Request processed in 204us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643121.281611:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788643121.281654:0:3641:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788643121.281662:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.118@tcp: connect to target with instance 0 00000100:00080000:2.0:1788643121.281668:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788643121.281672:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788643121.281675:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc9388800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788643121.281677:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788643121.281687:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788643121.281691:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da540a41-a984-4ac4-89dc-6d833e36a776:3641:1875527696866304:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788643121.294613:0:22731:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788643121.294802:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788643121.294809:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788643121.295874:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788643121.295882:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788643121.296329:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788643121.296335:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788643121.297602:0:22731:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788643121.297758:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788643121.297763:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788643121.298864:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788643121.298874:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788643121.338419:0:22731:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788643121.338610:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788643121.338616:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788643121.346056:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788643121.346070:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788643121.347887:0:22731:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788643121.348365:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788643121.348371:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788643121.348863:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788643121.348870:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788643121.349740:0:22731:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788643121.349883:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788643121.349888:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788643121.351839:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788643121.351850:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788643121.352681:0:22731:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788643121.353236:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788643121.353243:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788643121.354168:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788643121.354176:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788643121.386150:0:22731:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788643121.386342:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788643121.386348:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788643121.388106:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788643121.388117:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788643121.389162:0:22731:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788643121.389171:0:22731:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788643121.390317:0:22731:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788643121.390347:0:22731:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788643121.390353:0:22731:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788643121.390727:0:22731:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788643121.390772:0:22731:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.118@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788643121.390777:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788643121.390778:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788643121.390779:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788643121.390780:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788643121.390782:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788643121.390783:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788643121.390784:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788643121.390785:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788643121.390787:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788643121.390788:0:22731:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788643121.390791:0:22731:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788643121.390793:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788643121.390794:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788643121.390795:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788643121.390796:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788643121.390802:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788643121.390803:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788643121.390804:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788643121.390805:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788643121.390806:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788643121.390807:0:22731:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788643121.390831:0:22731:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788643121.390849:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696866432:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788643121.390920:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.391077:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefd53f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788643121.391137:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696866432 00000100:00100000:0.0:1788643121.391144:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696866432 00000100:00100000:0.0:1788643121.391231:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788643121.391242:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+5:22731:x1875527696866432:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788643121.391282:0:22746:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788643121.391285:0:22746:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788643121.391288:0:22746:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788643121.391682:0:22768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788643121.392212:0:22746:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1788643121.393623:0:22769:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788643121.393629:0:22769:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788643121.393633:0:22769:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788643121.393636:0:22769:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788643121.393941:0:22769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788643121.397542:0:22746:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788643121.397555:0:22746:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788643121.400325:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+5:22731:x1875527696866432:12345-0@lo:253:mount.lustre.0 Request processed in 9076us (9395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643121.400340:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788643121.400667:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696866432:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788643121.400682:0:22731:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788643121.400686:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788643121.400687:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788643121.400688:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788643121.400690:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788643121.400691:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788643121.400692:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788643121.400693:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788643121.400695:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788643121.400697:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788643121.400698:0:22731:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788643121.400719:0:22731:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cabc94a4800 from lustre-MDT0000 10000000:01000000:3.0:1788643121.400745:0:22731:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788643121.400748:0:22731:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788643121.400752:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cacfdc88000 10000000:01000000:3.0:1788643121.400756:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788643121.400764:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cacfdc88000 from 1 10000000:01000000:3.0:1788643121.400766:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788643121.400806:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.400817:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.400846:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643121.400866:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696866560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788643121.400921:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.400962:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefd53480 going to sleep for 11 seconds 00000100:00100000:2.0:1788643121.401046:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696866560 00000100:00100000:2.0:1788643121.401052:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696866560 00000100:00100000:2.0:1788643121.401125:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788643121.401133:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+5:22731:x1875527696866560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643121.401145:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643121.401158:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacc2811000/0x119ccc6e683c3c44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3c3d expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.401178:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc2811000/0x119ccc6e683c3c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3c3d expref: 6 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.401187:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacc2811000/0x119ccc6e683c3c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3c3d expref: 6 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.401194:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacc2811000, rc 0) 00000100:00100000:2.0:1788643121.401237:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+6:22731:x1875527696866560:12345-0@lo:101:mount.lustre.0 Request processed in 105us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643121.401243:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788643121.401303:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696866560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788643121.401315:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.401322:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643121.401368:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696866688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788643121.401413:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643121.404298:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696866688 00000100:00100000:0.0:1788643121.404325:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696866688 00000100:00100000:0.0:1788643121.404828:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788643121.404846:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+6:22731:x1875527696866688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643121.405007:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+6:22731:x1875527696866688:12345-0@lo:501:mount.lustre.0 Request processed in 167us (3593us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788643121.405016:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788643121.405569:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefd53480 going to sleep for 11 seconds 00000100:00100000:1.0:1788643121.405599:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696866688:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788643121.405647:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788643121.405669:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.405679:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788643121.405688:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cabc94a4800 10000000:01000000:1.0:1788643121.405694:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788643121.405698:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cabc94a4800 10000000:01000000:1.0:1788643121.405701:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788643121.405704:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cabc94a4800 from 1 10000000:01000000:1.0:1788643121.405706:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788643121.405737:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031e00/0x119ccc6e683c3c4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.405746:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc0031e00/0x119ccc6e683c3c4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.405755:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc0031e00/0x119ccc6e683c3c4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643121.405849:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696866816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788643121.405889:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643121.405912:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd0f670c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788643121.406052:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696866816 00000100:00100000:0.0:1788643121.406059:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696866816 00000100:00100000:0.0:1788643121.406880:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788643121.406893:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+6:22731:x1875527696866816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788643121.406907:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643121.406926:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacfe7abe00/0x119ccc6e683c3c52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3c4b expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.406951:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacfe7abe00/0x119ccc6e683c3c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3c4b expref: 7 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.406962:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacfe7abe00/0x119ccc6e683c3c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3c4b expref: 7 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.406982:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacfe7abe00, rc 0) 00000100:00100000:0.0:1788643121.407041:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+7:22731:x1875527696866816:12345-0@lo:101:mount.lustre.0 Request processed in 151us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643121.407048:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788643121.407138:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696866816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643121.407154:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc0031e00/0x119ccc6e683c3c4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c52 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.407162:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc0031e00/0x119ccc6e683c3c4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3c52 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643121.407178:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788643121.407200:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031e00/0x119ccc6e683c3c4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c52 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.407207:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc0031e00/0x119ccc6e683c3c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c52 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643121.407214:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788643121.407218:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788643121.407223:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cabc94a4800 10000000:01000000:2.0:1788643121.407226:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788643121.407229:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788643121.407231:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788643121.407256:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.407262:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.407270:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3c59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643121.407303:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696866944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788643121.407334:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643121.411146:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc53d1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643121.411297:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696866944 00000100:00100000:1.0:1788643121.411307:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696866944 00000100:00100000:1.0:1788643121.411407:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788643121.411417:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+7:22731:x1875527696866944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788643121.411433:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788643121.411454:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacc0030000/0x119ccc6e683c3c60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3c59 expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.411481:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc0030000/0x119ccc6e683c3c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3c59 expref: 8 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.411493:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacc0030000/0x119ccc6e683c3c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3c59 expref: 8 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.411502:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacc0030000, rc 0) 00000100:00100000:1.0:1788643121.411569:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+8:22731:x1875527696866944:12345-0@lo:101:mount.lustre.0 Request processed in 153us (4233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643121.411575:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788643121.411617:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696866944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643121.411640:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c60 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.411651:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3c59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3c60 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643121.411727:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696867072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643121.411760:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643121.411789:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc53d1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788643121.411844:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696867072 00000100:00100000:0.0:1788643121.411849:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696867072 00000100:00100000:0.0:1788643121.411925:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788643121.411934:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+8:22731:x1875527696867072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643121.412186:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+9:22731:x1875527696867072:12345-0@lo:501:mount.lustre.0 Request processed in 252us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643121.412193:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788643121.412292:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696867072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643121.412320:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696867200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788643121.412360:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643121.412790:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc53d1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788643121.412846:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696867200 00000100:00100000:0.0:1788643121.412851:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696867200 00000100:00100000:0.0:1788643121.412887:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788643121.412894:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+9:22731:x1875527696867200:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788643121.413924:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+9:22731:x1875527696867200:12345-0@lo:503:mount.lustre.0 Request processed in 1025us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643121.413936:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788643121.414051:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696867200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788643121.414854:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22770:1875527696867328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788643121.414904:0:22770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643121.414970:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd0f67d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788643121.415011:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696867328 00000100:00100000:3.0:1788643121.415019:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696867328 00000100:00100000:3.0:1788643121.415093:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788643121.415103:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+9:22770:x1875527696867328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788643121.415845:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+9:22770:x1875527696867328:12345-0@lo:502:llog_process_th.0 Request processed in 741us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643121.415854:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788643121.416040:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22770:1875527696867328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788643121.416069:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788643121.416079:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788643121.416081:0:22770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788643121.416085:0:22770:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788643121.416088:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788643121.416101:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9cacda7f3380) 00000020:00000080:1.0:1788643121.416116:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788643121.416122:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788643121.416215:0:22770:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788643121.416223:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x119ccc6e683c3c6e 00000020:00000080:1.0:1788643121.416580:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788643121.416585:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788643121.416589:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788643121.416591:0:22770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788643121.416594:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788643121.416598:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788643121.416600:0:22770:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788643121.416603:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788643121.416610:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9cacda7f4d40) 00000020:00000080:1.0:1788643121.416619:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788643121.416623:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788643121.416625:0:22770:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788643121.416628:0:22770:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788643121.416633:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788643121.416686:0:22770:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cabc94a4800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788643121.416699:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9cacda7f19c0) 00000020:00000080:1.0:1788643121.416706:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788643121.416764:0:22770:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788643121.416771:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x119ccc6e683c3c83 00000020:00000080:1.0:1788643121.416862:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788643121.416867:0:22770:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788643121.416871:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x119ccc6e683c3c8a 00080000:01000000:1.0:1788643121.416877:0:22770:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788643121.416880:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x119ccc6e683c3c91 00010000:00010000:3.0:1788643121.509958:0:22770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788643121.513792:0:22770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:3.0:1788643121.514693:0:22770:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788643121.515158:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9cacc880cd40) 00000020:00000080:3.0:1788643121.515175:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788643121.515254:0:22770:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788643121.515262:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x119ccc6e683c3c9f 00000020:00000080:3.0:1788643121.517335:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788643121.527606:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x119ccc6e683c3ca6 00000020:00000080:0.0:1788643121.528124:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788643121.528135:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643121.528141:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643121.528144:0:22770:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788643121.528147:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788643121.528150:0:22770:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788643121.528151:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788643121.528153:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788643121.528155:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788643121.528157:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643121.528159:0:22770:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788643121.528161:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643121.528166:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643121.528168:0:22770:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788643121.528173:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788643121.528314:0:22770:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788643121.528336:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643121.528340:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643121.528342:0:22770:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788643121.528344:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643121.528355:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643121.528357:0:22770:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788643121.528360:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788643121.528366:0:22770:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:00000080:0.0:1788643121.529139:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788643121.529159:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9cacfdc8b380) 00000020:00000080:0.0:1788643121.529176:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788643121.529183:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788643121.529251:0:22770:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788643121.529257:0:22770:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788643121.529262:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x119ccc6e683c3cb4 00010000:00080000:0.0:1788643121.529291:0:22770:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cabc89e7800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788643121.534187:0:22770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788643121.537505:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788643121.537519:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788643121.537558:0:22770:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788643121.537579:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x119ccc6e683c3cbb 00000100:00080000:3.0:1788643121.537589:0:22770:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788643121.537594:0:22770:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cabc89e7800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788643121.537626:0:22770:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc88e9f80 x1875527696867456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788643121.537647:0:22770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788643121.537765:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696867456:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788643121.537848:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788643121.537962:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643121.537966:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.537968:0:22770:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788643121.537980:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788643121.537983:0:22770:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788643121.537985:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788643121.537995:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788643121.537997:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788643121.538000:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.538002:0:22770:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788643121.538004:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788643121.538008:0:22770:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788643121.538012:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.538013:0:22770:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788643121.538016:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788643121.538020:0:22770:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:3.0:1788643121.538046:0:22770:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788643121.538049:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788643121.538061:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cacc8808000) 00000020:00000080:3.0:1788643121.538073:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788643121.538077:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788643121.538137:0:22770:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788643121.538143:0:22770:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788643121.538149:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x119ccc6e683c3cc9 00010000:00080000:3.0:1788643121.538175:0:22770:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cabc89e5000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.118@tcp at head 00000100:00100000:0.0:1788643121.538203:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696867456 00000100:00100000:0.0:1788643121.538211:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696867456 00000100:00100000:0.0:1788643121.538254:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788643121.538261:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875527696867456:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788643121.538275:0:22757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1788643121.538665:0:22770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788643121.539580:0:22770:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788643121.539822:0:22770:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788643121.541808:0:22770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788643121.542739:0:22770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788643121.552143:0:22770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1788643121.559102:0:22776:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788643121.559111:0:22776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788643121.566025:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788643121.566041:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788643121.566085:0:22770:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788643121.566103:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x119ccc6e683c3cd0 00000100:00080000:3.0:1788643121.566113:0:22770:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788643121.566118:0:22770:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cabc89e5000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788643121.566150:0:22770:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc88ea300 x1875527696867584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788643121.566181:0:22770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788643121.566238:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696867584:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788643121.566241:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643121.566248:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.566250:0:22770:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788643121.566253:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788643121.566257:0:22770:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788643121.566259:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788643121.566261:0:22770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788643121.566262:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788643121.566265:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.566267:0:22770:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788643121.566283:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788643121.566287:0:22770:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788643121.566292:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.566293:0:22770:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788643121.566297:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000400:00000100:2.0:1788643121.566300:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527696867584 offset 0 length 520: 4 00000020:00000080:3.0:1788643121.566304:0:22770:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:3.0:1788643121.566333:0:22770:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788643121.566336:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788643121.566349:0:22770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cabc7c399c0) 00000020:00000080:3.0:1788643121.566362:0:22770:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788643121.566367:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788643121.566465:0:22770:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788643121.566471:0:22770:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788643121.566477:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x119ccc6e683c3cde 00010000:00080000:3.0:1788643121.566504:0:22770:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cabc7914800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788643121.566688:0:22770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788643121.566746:0:22770:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788643121.566758:0:22770:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788643121.573062:0:22770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788643121.573487:0:22770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788643121.573694:0:22770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:0.0:1788643121.578288:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875527696867456:12345-0@lo:38:llog_process_th.0 Request processed in 40020us (40433us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788643121.578302:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788643121.578538:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788643121.578545:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788643121.578549:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696867456:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788643121.580440:0:22778:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788643121.580447:0:22778:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788643121.580740:0:22770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788643121.580752:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788643121.580788:0:22770:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788643121.580819:0:22770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x119ccc6e683c3ce5 00000100:00080000:1.0:1788643121.580830:0:22770:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788643121.580836:0:22770:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cabc7914800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788643121.580866:0:22770:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7ecfb80 x1875527696867712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788643121.580893:0:22770:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788643121.580952:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788643121.580956:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788643121.580958:0:22770:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788643121.580961:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788643121.580966:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788643121.580968:0:22770:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788643121.580971:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788643121.580973:0:22770:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788643121.580975:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1788643121.580980:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696867712:0@lo:8:llog_process_th.0 00000020:00000080:1.0:1788643121.580980:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788643121.580982:0:22770:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788643121.580999:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788643121.581003:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788643121.581006:0:22770:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788643121.581010:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788643121.581039:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22770:1875527696867840:0@lo:502:llog_process_th.0 00000400:00000100:2.0:1788643121.581054:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527696867712 offset 0 length 520: 4 00000100:00100000:1.0:1788643121.581101:0:22770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643121.581123:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefd5d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788643121.581135:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696867840 00000100:00100000:3.0:1788643121.581143:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696867840 00000100:00100000:3.0:1788643121.581186:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788643121.581204:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+9:22770:x1875527696867840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788643121.581324:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+9:22770:x1875527696867840:12345-0@lo:502:llog_process_th.0 Request processed in 129us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643121.581333:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788643121.581473:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22770:1875527696867840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788643121.581499:0:22770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788643121.581505:0:22770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788643121.581506:0:22770:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788643121.581510:0:22770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788643121.581583:0:22731:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788643121.581616:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788643121.581638:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3c59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c60 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.581650:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc2811200/0x119ccc6e683c3c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c60 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643121.581658:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cabc94a4800 from 1 10000000:01000000:2.0:1788643121.581660:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788643121.581685:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.581693:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.581702:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643121.581715:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696867968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788643121.581754:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.581798:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696867968 00000100:00100000:3.0:1788643121.581804:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696867968 00000100:00100000:3.0:1788643121.581838:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788643121.581851:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+9:22731:x1875527696867968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788643121.581861:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643121.581876:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3cec expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.581895:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3cec expref: 10 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.581906:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3cec expref: 10 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.581914:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cad02174000, rc 0) 00000100:00100000:3.0:1788643121.581941:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+10:22731:x1875527696867968:12345-0@lo:101:mount.lustre.0 Request processed in 90us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643121.581947:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788643121.582465:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd0849cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788643121.582570:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696867968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643121.582587:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.582598:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643121.584080:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868096:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788643121.584151:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643121.584196:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd0849cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643121.584250:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696868096 00000100:00100000:3.0:1788643121.584257:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696868096 00000100:00100000:3.0:1788643121.584312:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788643121.584322:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+10:22731:x1875527696868096:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788643121.584340:0:22744:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788643121.584346:0:22744:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788643121.584456:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+10:22731:x1875527696868096:12345-0@lo:256:mount.lustre.0 Request processed in 136us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643121.584463:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788643121.584559:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868096:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788643121.585168:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788643121.585192:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.585204:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788643121.585212:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cabc94a4800 from 1 10000000:01000000:1.0:1788643121.585215:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788643121.585249:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.585256:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.585266:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643121.585282:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788643121.585322:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643121.585356:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd056e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788643121.585415:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696868224 00000100:00100000:0.0:1788643121.585421:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696868224 00000100:00100000:0.0:1788643121.585472:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788643121.585564:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+10:22731:x1875527696868224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788643121.585578:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643121.585593:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacfe7aa200/0x119ccc6e683c3d01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3cfa expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.585629:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacfe7aa200/0x119ccc6e683c3d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3cfa expref: 11 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.585641:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacfe7aa200/0x119ccc6e683c3d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3cfa expref: 11 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.585650:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacfe7aa200, rc 0) 00000100:00100000:0.0:1788643121.585710:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+11:22731:x1875527696868224:12345-0@lo:101:mount.lustre.0 Request processed in 149us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643121.585719:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788643121.585766:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788643121.585781:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.585802:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643121.585863:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788643121.585890:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.585921:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3195a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788643121.586174:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696868352 00000100:00100000:2.0:1788643121.586179:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696868352 00000100:00100000:2.0:1788643121.586212:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788643121.586219:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+11:22731:x1875527696868352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643121.586359:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+11:22731:x1875527696868352:12345-0@lo:501:mount.lustre.0 Request processed in 140us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643121.586368:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788643121.587318:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788643121.587363:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788643121.587455:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.587483:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3195a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788643121.587648:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696868480 00000100:00100000:2.0:1788643121.587656:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696868480 00000100:00100000:0.0:1788643121.587733:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788643121.587747:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+11:22731:x1875527696868480:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788643121.589597:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+11:22731:x1875527696868480:12345-0@lo:503:mount.lustre.0 Request processed in 1847us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643121.589608:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788643121.589803:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788643121.591725:0:22780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22780:1875527696868608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788643121.591807:0:22780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.591847:0:22780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc31959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643121.591883:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696868608 00000100:00100000:1.0:1788643121.591891:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696868608 00000100:00100000:1.0:1788643121.591943:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788643121.591952:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+11:22780:x1875527696868608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788643121.593664:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+11:22780:x1875527696868608:12345-0@lo:502:llog_process_th.0 Request processed in 1706us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643121.593727:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788643121.593917:0:22780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22780:1875527696868608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788643121.593951:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788643121.593960:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.593962:0:22780:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788643121.593968:0:22780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cabc94a4800 00000020:00000080:3.0:1788643121.593971:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788643121.593977:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643121.593980:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.593981:0:22780:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788643121.593983:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788643121.593985:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.594000:0:22780:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788643121.594005:0:22780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cabc94a4800 00000020:00000080:3.0:1788643121.594007:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788643121.594063:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643121.594066:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.594068:0:22780:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788643121.594070:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788643121.594072:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.594074:0:22780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788643121.594077:0:22780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cabc94a4800 00000020:00000080:3.0:1788643121.594079:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788643121.594093:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643121.594095:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.594096:0:22780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788643121.594098:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788643121.594100:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.594102:0:22780:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788643121.594105:0:22780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cabc94a4800 00000020:00000080:3.0:1788643121.594107:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788643121.594143:0:22780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22780:1875527696868736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788643121.594184:0:22780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.594696:0:22780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc31959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643121.595100:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696868736 00000100:00100000:1.0:1788643121.595107:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696868736 00000100:00100000:1.0:1788643121.595187:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788643121.595197:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+11:22780:x1875527696868736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788643121.595306:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+11:22780:x1875527696868736:12345-0@lo:502:llog_process_th.0 Request processed in 110us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643121.595314:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788643121.595430:0:22780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22780:1875527696868736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788643121.595455:0:22780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643121.595462:0:22780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643121.595464:0:22780:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788643121.595467:0:22780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788643121.600117:0:22731:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788643121.600152:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788643121.600175:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.600188:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643121.600251:0:22731:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788643121.600254:0:22731:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cabc94a4800 10000000:01000000:0.0:1788643121.600257:0:22731:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cabc94a4800 10000000:01000000:0.0:1788643121.600262:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788643121.600268:0:22731:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cabc94a4800 from 1 10000000:01000000:0.0:1788643121.600271:0:22731:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788643121.600313:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7abc00/0x119ccc6e683c3d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.600327:0:22731:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacfe7abc00/0x119ccc6e683c3d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.600339:0:22731:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacfe7abc00/0x119ccc6e683c3d08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643121.600363:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788643121.601635:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643121.601683:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6179600 going to sleep for 11 seconds 00000100:00100000:1.0:1788643121.601886:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696868864 00000100:00100000:1.0:1788643121.601894:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696868864 00000100:00100000:1.0:1788643121.601934:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788643121.601943:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+11:22731:x1875527696868864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788643121.601956:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788643121.601972:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacc0031600/0x119ccc6e683c3d0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3d08 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.602007:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc0031600/0x119ccc6e683c3d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3d08 expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.602019:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacc0031600/0x119ccc6e683c3d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3d08 expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.602028:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacc0031600, rc 0) 00000100:00100000:1.0:1788643121.602067:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+12:22731:x1875527696868864:12345-0@lo:101:mount.lustre.0 Request processed in 126us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643121.602074:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788643121.602263:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788643121.602280:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacfe7abc00/0x119ccc6e683c3d08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d0f expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.602289:0:22731:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7abc00/0x119ccc6e683c3d08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3d0f expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643121.602354:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643121.602401:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643121.602421:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6179600 going to sleep for 11 seconds 00000100:00100000:3.0:1788643121.605335:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696868992 00000100:00100000:3.0:1788643121.605349:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696868992 00000100:00100000:3.0:1788643121.605429:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788643121.605439:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+12:22731:x1875527696868992:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788643121.615273:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+12:22731:x1875527696868992:12345-0@lo:501:mount.lustre.0 Request processed in 9827us (12863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643121.615287:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788643121.615643:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696868992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643121.615709:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7456a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696869120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788643121.615770:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643121.615814:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788643121.615838:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696869120 00000100:00100000:0.0:1788643121.615846:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696869120 00000100:00100000:0.0:1788643121.615890:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788643121.615900:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+12:22731:x1875527696869120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788643121.618025:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+12:22731:x1875527696869120:12345-0@lo:503:mount.lustre.0 Request processed in 2120us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643121.618039:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788643121.618052:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7456a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696869120:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788643121.619072:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22785:1875527696869248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788643121.619138:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.619179:0:22785:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3195540 going to sleep for 11 seconds 00000100:00100000:2.0:1788643121.619277:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696869248 00000100:00100000:2.0:1788643121.619289:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696869248 00000100:00100000:2.0:1788643121.619332:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788643121.619340:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+12:22785:x1875527696869248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788643121.619740:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+12:22785:x1875527696869248:12345-0@lo:502:llog_process_th.0 Request processed in 400us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643121.619749:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788643121.620313:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22785:1875527696869248:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788643121.620398:0:22785:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788643121.620418:0:22785:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9cabc7c3b380) 00000020:00000080:3.0:1788643121.620437:0:22785:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788643121.620513:0:22785:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cabc94a4800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788643121.620517:0:22785:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cabc94a4800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788643121.620520:0:22785:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cabc94a4800 4 00010000:00080000:3.0:1788643121.620550:0:22785:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cabc5da7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788643121.622117:0:22785:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788643121.622316:0:22785:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788643121.622355:0:22785:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788643121.622367:0:22785:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x119ccc6e683c3d1d 00000100:00080000:3.0:1788643121.622377:0:22785:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788643121.622403:0:22785:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cabc5da7000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788643121.622432:0:22785:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc88e8700 x1875527696869376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788643121.622454:0:22785:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788643121.623204:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22785:1875527696869504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788643121.623279:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.623599:0:22785:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3195c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788643121.624206:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696869504 00000100:00100000:0.0:1788643121.624214:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696869504 00000100:00100000:0.0:1788643121.624313:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788643121.624324:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+12:22785:x1875527696869504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788643121.624629:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+12:22785:x1875527696869504:12345-0@lo:502:llog_process_th.0 Request processed in 302us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643121.624638:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788643121.624748:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22785:1875527696869504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788643121.624802:0:22785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22785:1875527696869632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788643121.624842:0:22785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.624867:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696869632 00000100:00100000:3.0:1788643121.624871:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696869632 00000100:00100000:3.0:1788643121.624896:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788643121.624903:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+12:22785:x1875527696869632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788643121.624978:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+12:22785:x1875527696869632:12345-0@lo:502:llog_process_th.0 Request processed in 75us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643121.624986:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788643121.625039:0:22785:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3195c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788643121.625051:0:22785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88ead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:da540a41-a984-4ac4-89dc-6d833e36a776:22785:1875527696869632:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788643121.625070:0:22785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:3.0:1788643121.625507:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875527696869376:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788643121.625542:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.625584:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696869376 00000100:00100000:3.0:1788643121.625589:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696869376 00000100:00100000:3.0:1788643121.625613:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788643121.625618:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875527696869376:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788643121.625660:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875527696869376:12345-0@lo:38:llog_process_th.0 Request processed in 41us (118us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788643121.625667:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788643121.625691:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788643121.625704:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc5da7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788643121.625708:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788643121.625712:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875527696869376:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788643121.628364:0:22731:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788643121.628412:0:22731:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788643121.628429:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7abc00/0x119ccc6e683c3d08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d0f expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643121.628440:0:22731:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacfe7abc00/0x119ccc6e683c3d08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d0f expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788643121.628491:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788643121.628494:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788643121.628495:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788643121.628497:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788643121.628498:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788643121.628500:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788643121.628501:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788643121.628502:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788643121.628504:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788643121.628506:0:22731:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788643121.628510:0:22731:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788643121.628512:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788643121.628514:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788643121.628515:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788643121.628516:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788643121.628517:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788643121.628518:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788643121.628519:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788643121.628520:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788643121.628522:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788643121.628529:0:22731:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788643121.628552:0:22731:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788643121.628573:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7456680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696869760:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788643121.628635:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643121.628672:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccc4b5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788643121.628690:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696869760 00000100:00100000:3.0:1788643121.628697:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696869760 00000100:00100000:3.0:1788643121.628740:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788643121.628750:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+12:22731:x1875527696869760:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788643121.628775:0:22744:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788643121.628788:0:22744:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788643121.634805:0:22744:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788643121.634818:0:22744:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788643121.634894:0:22768:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788643121.634899:0:22768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788643121.634919:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.634938:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3cec expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.634946:0:22768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.634980:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3cec expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643121.635006:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3cf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3cec expref: 12 pid: 22745 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643121.635020:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696869888:0@lo:104: 00000100:00100000:0.0:1788643121.638827:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643121.638898:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf61799c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643121.639345:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696869888 00000100:00100000:3.0:1788643121.639353:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696869888 00000100:00100000:3.0:1788643121.639459:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788643121.639470:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+3:22768:x1875527696869888:12345-0@lo:104: 00010000:00010000:3.0:1788643121.639486:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.639566:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788643121.639572:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+3:22768:x1875527696869888:12345-0@lo:104: Request processed in 106us (4492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643121.639580:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788643121.639650:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+12:22731:x1875527696869760:12345-0@lo:253:mount.lustre.0 Request processed in 10902us (11014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643121.639659:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788643121.639673:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7456680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:22731:1875527696869760:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788643121.639689:0:22731:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788643121.639692:0:22731:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788643121.639694:0:22731:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788643121.639695:0:22731:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788643121.639696:0:22731:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788643121.639697:0:22731:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788643121.639698:0:22731:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788643121.639699:0:22731:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788643121.639701:0:22731:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788643121.639702:0:22731:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788643121.639703:0:22731:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788643121.639717:0:22731:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788643121.639823:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696869888:0@lo:104: 00010000:00010000:0.0:1788643121.639845:0:22768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.639914:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788643121.639927:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.639936:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc2811400 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:1.0:1788643121.639940:0:22741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.639949:0:22741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788643121.639955:0:22741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788643121.639961:0:22741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788643121.640013:0:22741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.640020:0:22741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788643121.640048:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.640055:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3cec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3cf3 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.640070:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643121.640071:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643121.640073:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643121.640116:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788643121.640126:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696870016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788643121.640161:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643121.641249:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696870016 00000100:00100000:3.0:1788643121.641258:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696870016 00010000:00010000:3.0:1788643121.641283:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3cf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3cec expref: 12 pid: 22745 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643121.641374:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788643121.641407:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da540a41-a984-4ac4-89dc-6d833e36a776+12:3642:x1875527696870016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788643121.641421:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788643121.641428:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3cf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3cec expref: 12 pid: 22745 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.641439:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3cec expref: 12 pid: 22745 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.641453:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3cf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3cec expref: 12 pid: 22745 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.641469:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.641477:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788643121.641492:0:22737:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006594089s 00010000:00010000:3.0:1788643121.641496:0:22737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.641504:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.641510:0:22737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.641517:0:22737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.641528:0:22737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab800 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643121.641532:0:22737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.641540:0:22737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.641565:0:22737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643121.641575:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788643121.641622:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da540a41-a984-4ac4-89dc-6d833e36a776+11:3642:x1875527696870016:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643121.641631:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788643121.641654:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696870016:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788643121.641690:0:22768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.641699:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643121.641705:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d24 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788643121.678906:0:22731:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:1.0:1788643121.679102:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788643121.679302:0:22792:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:1.0:1788643121.679306:0:22792:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:0.0:1788643121.681056:0:22793:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788643121.681076:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788643121.682190:0:22793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788643121.684424:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788643121.684465:0:22731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788643121.685011:0:22731:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788643121.685020:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788643121.685061:0:22731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788643121.686036:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788643121.689216:0:22793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788643121.689288:0:22793:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:3.0:1788643121.689871:0:22794:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9cacc88e8700 x1875527696870144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643121.689884:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00000040:00080000:2.0:1788643121.691247:0:22731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788643121.691469:0:22731:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788643121.694246:0:22731:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788643121.694848:0:22731:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1788643121.697878:0:22731:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788643121.702809:0:22731:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788643121.702848:0:22731:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa83bc1997988 00100000:10000000:0.0:1788643121.702855:0:22731:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788643121.705372:0:22731:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788643121.705420:0:22731:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788643121.705447:0:22731:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788643121.705471:0:22731:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788643121.706198:0:22731:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788643121.706442:0:22731:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788643122.316045:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788643122.638665:0:22787:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788643122.638673:0:22787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788643122.642602:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788643122.642616:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788643122.700726:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 10000000:01000000:0.0:1788643123.089072:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788643123.089083:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cabc94a4800 from 11 10000000:01000000:0.0:1788643123.089090:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788643123.089153:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643123.089167:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643123.089179:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643123.089231:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696870272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788643123.089326:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643123.089398:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccba21c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788643123.089426:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696870272 00000100:00100000:0.0:1788643123.089435:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696870272 00000100:00100000:0.0:1788643123.089503:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788643123.089513:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+11:22749:x1875527696870272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788643123.089529:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643123.089544:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacfe7aa600/0x119ccc6e683c3d32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3d2b expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643123.089573:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacfe7aa600/0x119ccc6e683c3d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3d2b expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643123.089585:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacfe7aa600/0x119ccc6e683c3d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3d2b expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643123.089596:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacfe7aa600, rc 0) 00000100:00100000:0.0:1788643123.089641:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+12:22749:x1875527696870272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643123.089648:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788643123.089737:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696870272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788643123.089754:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643123.089765:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643123.089825:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696870400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788643123.089932:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643123.089950:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cace70336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643123.091040:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696870400 00000100:00100000:3.0:1788643123.091050:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696870400 00000100:00100000:3.0:1788643123.091100:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788643123.091110:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+12:22749:x1875527696870400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788643123.091133:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788643123.091153:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788643123.091157:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788643123.091273:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+12:22749:x1875527696870400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 165us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643123.091290:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788643123.091961:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696870400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788643123.092031:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788643123.092043:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643123.092055:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643123.348276:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788643123.662895:0:22787:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788643123.662909:0:22787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788643123.663114:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788643123.663171:0:22787:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788643123.663359:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1788643123.723525:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00010000:00010000:1.0:1788643124.364540:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643124.748165:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00000001:02000400:2.0:1788643125.371262:0:23037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788643125.387519:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643125.772454:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00000020:00000004:3.0:1788643126.268611:0:23089:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788643126.268789:0:23089:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788643126.412816:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643126.798592:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00000100:00080000:2.0:1788643126.988730:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788643126.988742:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788643126.988745:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788643126.988753:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 602 00000100:00080000:2.0:1788643126.988758:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788643126.988763:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cabc89e7800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643126.988781:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7454700 x1875527696870656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788643126.988792:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696870528:0@lo:400:kworker.0 00000100:00080000:2.0:1788643126.988806:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788643126.988812:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788643126.988815:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788643126.988823:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696870656:0@lo:38:kworker.0 00000100:00080000:2.0:1788643126.988829:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788643126.988833:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788643126.988836:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788643126.988838:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cabc5da7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788643126.988843:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cabc5da7000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643126.988856:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7456d80 x1875527696870784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788643126.988860:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643126.988860:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643126.988911:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696870528 00000100:00100000:0.0:1788643126.988916:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875527696870784:0@lo:38:kworker.0 00000100:00100000:3.0:1788643126.988919:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696870528 00000100:00100000:0.0:1788643126.989034:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643126.989061:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788643126.989070:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+12:3644:x1875527696870528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643126.989114:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+12:3644:x1875527696870528:12345-0@lo:400:kworker.0 Request processed in 45us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643126.989130:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788643126.989162:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696870784 00000100:00100000:3.0:1788643126.989165:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696870784 00000100:00100000:3.0:1788643126.989180:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788643126.989185:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875527696870784:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788643126.989222:0:22754:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 608 last 0 00000020:00000080:3.0:1788643126.989256:0:22754:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x119ccc6e683c3d39 00000004:00100000:3.0:1788643126.989269:0:22754:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788643126.989421:0:22754:0:(import.c:65:import_set_state_nolock()) ffff9cabc7917800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788643126.989454:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875527696870784:12345-0@lo:38:kworker.0 Request processed in 268us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643126.989461:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788643126.989921:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696870528:0@lo:400:kworker.0 00010000:00080000:0.0:1788643126.990193:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cabc7456d80 x1875527696870784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788643136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788643126.990323:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788643126.990331:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788643126.990336:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788643126.990339:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc5da7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788643126.990344:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7456d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875527696870784:0@lo:38:kworker.0 00000100:00100000:0.0:1788643126.990405:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696870656 00000100:00100000:0.0:1788643126.990414:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696870656 00000100:00100000:0.0:1788643126.990440:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788643126.990445:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875527696870656:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788643126.990458:0:22758:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788643126.990508:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875527696870656:12345-0@lo:38:kworker.0 Request processed in 62us (1649us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788643126.990515:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788643126.990587:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788643126.990592:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788643126.990595:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696870656:0@lo:38:kworker.0 00000020:00000004:2.0:1788643126.995586:0:23139:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788643126.995758:0:23139:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788643127.435613:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643127.820465:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00010000:00010000:0.0:1788643128.459769:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643128.843800:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00010000:00010000:1.0:1788643129.489918:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643129.874762:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00010000:00010000:3.0:1788643130.508824:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643130.891484:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00000100:00100000:0.0:1788643131.087246:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643121/real 1788643121] req@ffff9cabc7ecfb80 x1875527696867712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643131 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643131.091463:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cabc7ecfb80 x1875527696867712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643131 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643131.091481:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643121/real 1788643121] req@ffff9cacc88ea300 x1875527696867584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643131 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643131.091496:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cacc88ea300 x1875527696867584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643131 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788643131.091515:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc7914800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788643131.091551:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788643131.091556:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696867712:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788643131.091562:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788643131.091568:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788643131.091572:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696867584:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788643131.091622:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:0.0:1788643131.091624:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696870912:0@lo:400:kworker.0 00000100:00080000:1.0:1788643131.091630:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788643131.091635:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788643131.091641:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 608 00000100:00080000:1.0:1788643131.091646:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788643131.091654:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cabc89e7800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788643131.091695:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7ecdc00 x1875527696871040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788643131.091712:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788643131.091716:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788643131.091718:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788643131.091721:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 602 00000100:00080000:1.0:1788643131.091724:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788643131.091729:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cabc89e5000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643131.091731:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643131.091745:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7ece680 x1875527696871168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788643131.091754:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788643131.091756:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788643131.091758:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cabc7914800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788643131.091762:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 602 00000100:00080000:1.0:1788643131.091764:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788643131.091767:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cabc7914800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788643131.091777:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7ecf480 x1875527696871296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788643131.091808:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696870912 00000100:00100000:0.0:1788643131.091817:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696870912 00000100:00100000:1.0:1788643131.091821:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875527696871424:0@lo:400:kworker.0 00000100:00100000:0.0:1788643131.091865:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788643131.091875:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+12:3645:x1875527696870912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643131.091882:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643131.091953:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+12:3645:x1875527696870912:12345-0@lo:400:kworker.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643131.091957:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696871424 00000100:00100000:1.0:1788643131.091962:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696871424 00000100:00100000:0.0:1788643131.091962:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788643131.091998:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788643131.092006:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875527696871424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643131.092018:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696870912:0@lo:400:kworker.0 00000100:00100000:1.0:1788643131.092049:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875527696871424:12345-0@lo:400:kworker.0 Request processed in 44us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643131.092076:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788643131.092109:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cabc7ecd180 x1875527696871424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643131.092120:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875527696871424:0@lo:400:kworker.0 00000100:00100000:1.0:1788643131.092153:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696871040:0@lo:38:kworker.0 00000100:00100000:1.0:1788643131.092197:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643131.092225:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696871168:0@lo:8:kworker.0 00000400:00000100:1.0:1788643131.092272:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527696871168 offset 0 length 520: 4 00000100:00100000:1.0:1788643131.092292:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696871296:0@lo:8:kworker.0 00000400:00000100:1.0:1788643131.092314:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527696871296 offset 0 length 520: 4 00000100:00100000:0.0:1788643131.093042:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696871040 00000100:00100000:0.0:1788643131.093047:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696871040 00000100:00100000:0.0:1788643131.093094:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788643131.093100:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875527696871040:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788643131.094354:0:22757:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788643131.094477:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875527696871040:12345-0@lo:38:kworker.0 Request processed in 1374us (2278us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788643131.094486:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788643131.095430:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788643131.095438:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788643131.095442:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696871040:0@lo:38:kworker.0 00010000:00010000:0.0:1788643131.531588:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643131.915487:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00000020:01000004:2.0:1788643132.483909:0:23484:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788643132.483918:0:23484:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788643132.483920:0:23484:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788643132.484034:0:23484:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cabc783a000 00000020:01000004:2.0:1788643132.484050:0:23484:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788643132.484068:0:23484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788643132.484080:0:23484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9cacf6cf19c0) 00000020:00000080:2.0:1788643132.484094:0:23484:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788643132.555482:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788643132.577952:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.579016:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788643132.584507:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.584755:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.584999:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.585203:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.585544:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.585744:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.586045:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.586335:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.586641:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.587005:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.587842:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.588647:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.588976:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.589249:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.589691:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.590019:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.590335:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.590640:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.590900:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.591517:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.592029:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.593728:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.594976:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.595435:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.595675:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.596149:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.596529:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.596877:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.597355:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.597611:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.597967:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788643132.598541:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788643132.601014:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788643132.602205:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788643132.602560:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788643132.602844:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788643132.603552:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788643132.605517:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788643132.605963:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788643132.606740:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788643132.607196:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788643132.607497:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788643132.607833:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788643132.608058:0:23484:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788643132.610113:0:23484:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788643132.610627:0:23484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788643132.610639:0:23484:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788643132.610650:0:23484:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x119ccc6e683c3d47 00000020:01000004:3.0:1788643132.610657:0:23484:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788643132.610725:0:23484:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788643132.610729:0:23484:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788643132.610734:0:23484:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788643132.610771:0:23484:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788643132.610774:0:23484:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788643132.615611:0:23484:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788643132.615654:0:23484:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.118@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788643132.615659:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788643132.615660:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788643132.615662:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788643132.615663:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788643132.615664:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788643132.615666:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788643132.615667:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788643132.615669:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788643132.615670:0:23484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788643132.615672:0:23484:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788643132.615674:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788643132.615676:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788643132.615677:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788643132.615678:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788643132.615679:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788643132.615680:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788643132.615681:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788643132.615682:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788643132.615683:0:23484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788643132.615707:0:23484:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788643132.615725:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696871552:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788643132.616134:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.616173:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd0f67d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788643132.617452:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696871552 00000100:00100000:3.0:1788643132.617462:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696871552 00000100:00100000:3.0:1788643132.617789:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788643132.617799:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+12:23484:x1875527696871552:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788643132.617865:0:22744:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788643132.617869:0:22744:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788643132.617875:0:22744:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788643132.618303:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+12:23484:x1875527696871552:12345-0@lo:253:mount.lustre.0 Request processed in 504us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.618312:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788643132.619143:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696871552:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788643132.619158:0:23484:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788643132.619161:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788643132.619163:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788643132.619164:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788643132.619165:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788643132.619166:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788643132.619167:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788643132.619168:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788643132.619170:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788643132.619171:0:23484:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788643132.619200:0:23484:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cabc783a000 from lustre-MDT0001 10000000:01000000:2.0:1788643132.619700:0:23484:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788643132.619704:0:23484:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788643132.619726:0:23484:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cacfdc88000 local copy 00010000:00010000:2.0:1788643132.619770:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643132.619869:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696871680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643132.619914:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643132.619960:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc8c3f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788643132.620001:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696871680 00000100:00100000:0.0:1788643132.620007:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696871680 00000100:00100000:0.0:1788643132.620049:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788643132.620061:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+12:23484:x1875527696871680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643132.620141:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+12:23484:x1875527696871680:12345-0@lo:501:mount.lustre.0 Request processed in 80us (226us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788643132.620148:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788643132.620221:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696871680:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788643132.621155:0:23484:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788643132.621183:0:23484:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788643132.621190:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.621202:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643132.621260:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cabc783a000 10000000:01000000:2.0:1788643132.621266:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788643132.621271:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cacfdc88000 10000000:01000000:2.0:1788643132.621273:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788643132.621277:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cacfdc88000 from 1 10000000:01000000:2.0:1788643132.621279:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788643132.621307:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811600/0x119ccc6e683c3d4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.621315:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc2811600/0x119ccc6e683c3d4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.621324:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc2811600/0x119ccc6e683c3d4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643132.621339:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696871808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788643132.621577:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643132.621612:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc8c3f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788643132.621664:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696871808 00000100:00100000:0.0:1788643132.621670:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696871808 00000100:00100000:0.0:1788643132.621712:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788643132.621727:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+12:23484:x1875527696871808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788643132.621739:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643132.621753:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d55 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3d4e expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643132.621774:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3d4e expref: 13 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643132.621783:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacfe7ab800/0x119ccc6e683c3d55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3d4e expref: 13 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643132.621791:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacfe7ab800, rc 0) 00000100:00100000:0.0:1788643132.621839:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+13:23484:x1875527696871808:12345-0@lo:101:mount.lustre.0 Request processed in 112us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643132.621845:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788643132.622063:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696871808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643132.622076:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc2811600/0x119ccc6e683c3d4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d55 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.622086:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc2811600/0x119ccc6e683c3d4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3d55 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643132.622100:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788643132.622116:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811600/0x119ccc6e683c3d4e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d55 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.622133:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc2811600/0x119ccc6e683c3d4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d55 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643132.622142:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cabc783a000 10000000:01000000:2.0:1788643132.622146:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788643132.622149:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cabc783a000 from 1 10000000:01000000:2.0:1788643132.622152:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788643132.622169:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811e00/0x119ccc6e683c3d5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.622176:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc2811e00/0x119ccc6e683c3d5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.622184:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc2811e00/0x119ccc6e683c3d5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643132.622197:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696871936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788643132.622224:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643132.622336:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696871936 00000100:00100000:3.0:1788643132.622342:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696871936 00000100:00100000:3.0:1788643132.622372:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788643132.622407:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+13:23484:x1875527696871936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788643132.622415:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643132.622424:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3d63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3d5c expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.622440:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3d5c expref: 14 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.622457:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cad02174000/0x119ccc6e683c3d63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3d5c expref: 14 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.622464:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cad02174000, rc 0) 00000100:00100000:3.0:1788643132.622493:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+14:23484:x1875527696871936:12345-0@lo:101:mount.lustre.0 Request processed in 114us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.622499:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788643132.622628:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc8c3f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788643132.622642:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696871936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643132.622655:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc2811e00/0x119ccc6e683c3d5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d63 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.622662:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc2811e00/0x119ccc6e683c3d5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3d63 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643132.622672:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788643132.622676:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811e00/0x119ccc6e683c3d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d63 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.622691:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc2811e00/0x119ccc6e683c3d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d63 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643132.622696:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788643132.622699:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788643132.622704:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cabc783a000 10000000:01000000:2.0:1788643132.622707:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788643132.622709:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788643132.622712:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788643132.622725:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3d6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.622733:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3d6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.622740:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3d6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643132.622753:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696872064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788643132.622778:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643132.622805:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc8c3f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788643132.622906:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696872064 00000100:00100000:3.0:1788643132.622923:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696872064 00000100:00100000:3.0:1788643132.622966:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788643132.622973:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+14:23484:x1875527696872064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788643132.622980:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643132.622989:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cad02175000/0x119ccc6e683c3d71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3d6a expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.623003:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cad02175000/0x119ccc6e683c3d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3d6a expref: 15 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.623012:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cad02175000/0x119ccc6e683c3d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3d6a expref: 15 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.623018:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cad02175000, rc 0) 00000100:00100000:3.0:1788643132.623056:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+15:23484:x1875527696872064:12345-0@lo:101:mount.lustre.0 Request processed in 83us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.623063:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788643132.623169:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696872064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788643132.623181:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3d6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d71 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643132.623188:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3d6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3d71 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788643132.626273:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1788643132.627141:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788643132.634646:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788643132.634703:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1788643132.634717:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1788643132.634730:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1788643132.634741:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1788643132.634752:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1788643132.634764:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1788643132.634778:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1788643132.634803:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1788643132.634817:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1788643132.634829:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1788643132.634842:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1788643132.634856:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1788643132.634871:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1788643132.634883:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1788643132.634895:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1788643132.634908:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1788643132.635120:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1788643132.635135:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1788643132.635149:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1788643132.635163:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1788643132.635176:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1788643132.635188:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1788643132.635201:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1788643132.635213:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1788643132.635224:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1788643132.636021:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1788643132.636066:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1788643132.636080:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1788643132.636092:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1788643132.636106:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1788643132.636120:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1788643132.636131:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1788643132.636145:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1788643132.636159:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1788643132.636172:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1788643132.636184:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1788643132.636195:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1788643132.636206:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1788643132.636218:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1788643132.636229:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1788643132.637129:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1788643132.637145:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1788643132.637159:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1788643132.637186:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1788643132.637191:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1788643132.637315:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696872192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643132.637394:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643132.637533:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc8c3f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788643132.637884:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696872192 00000100:00100000:3.0:1788643132.637891:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696872192 00000100:00100000:2.0:1788643132.638042:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788643132.638051:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+15:23484:x1875527696872192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643132.638199:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+15:23484:x1875527696872192:12345-0@lo:501:mount.lustre.0 Request processed in 148us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643132.638207:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788643132.638518:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696872192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643132.638556:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696872320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788643132.638671:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.638752:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788643132.638786:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696872320 00000100:00100000:2.0:1788643132.638791:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696872320 00000100:00100000:2.0:1788643132.638826:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788643132.638833:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+15:23484:x1875527696872320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788643132.640259:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+15:23484:x1875527696872320:12345-0@lo:503:mount.lustre.0 Request processed in 1422us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643132.640270:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788643132.640641:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696872320:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788643132.641963:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788643132.642276:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696872448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643132.642338:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.642412:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfe180 going to sleep for 11 seconds 00000100:00100000:2.0:1788643132.642841:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696872448 00000100:00100000:2.0:1788643132.642849:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696872448 00000100:00100000:2.0:1788643132.642896:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788643132.642905:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+15:23484:x1875527696872448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788643132.644136:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+15:23484:x1875527696872448:12345-0@lo:502:mount.lustre.0 Request processed in 1228us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643132.644146:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788643132.644231:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696872448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788643132.644472:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788643132.644679:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1788643132.644696:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1788643132.644707:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1788643132.644718:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1788643132.644730:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1788643132.644743:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1788643132.644755:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1788643132.644767:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1788643132.644778:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1788643132.644789:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1788643132.644800:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1788643132.644812:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1788643132.644825:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1788643132.644835:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1788643132.644846:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1788643132.644857:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1788643132.644869:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1788643132.644880:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1788643132.644892:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1788643132.644904:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1788643132.645047:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1788643132.645064:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1788643132.645100:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1788643132.645117:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1788643132.645130:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1788643132.645142:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1788643132.645155:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1788643132.645166:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1788643132.645178:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1788643132.645190:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1788643132.645200:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1788643132.645212:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1788643132.645225:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1788643132.646053:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1788643132.646082:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1788643132.646160:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1788643132.646179:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1788643132.646194:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1788643132.646205:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1788643132.646216:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1788643132.646227:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1788643132.646437:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1788643132.646460:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1788643132.646501:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696872576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643132.646618:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.646704:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfe180 going to sleep for 11 seconds 00000100:00100000:2.0:1788643132.646750:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696872576 00000100:00100000:2.0:1788643132.646757:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696872576 00000100:00100000:2.0:1788643132.646856:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788643132.646866:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+15:23484:x1875527696872576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788643132.647089:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+15:23484:x1875527696872576:12345-0@lo:502:mount.lustre.0 Request processed in 224us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643132.647107:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788643132.647265:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696872576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788643132.647310:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1788643132.647318:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788643132.648079:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643132.648090:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643132.648103:0:23488:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788643132.648108:0:23488:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788643132.648117:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788643132.648130:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9cacfdc899c0) 00000020:00000080:0.0:1788643132.648148:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788643132.648154:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788643132.648233:0:23488:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788643132.648240:0:23488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x119ccc6e683c3d7f 00000020:00000080:0.0:1788643132.648668:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788643132.648673:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643132.648677:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643132.648678:0:23488:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788643132.648681:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643132.648685:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643132.648686:0:23488:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788643132.648689:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788643132.648696:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9cacfdc8cd40) 00000020:00000080:0.0:1788643132.648707:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788643132.648711:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788643132.648713:0:23488:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788643132.648716:0:23488:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788643132.648721:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788643132.648765:0:23488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cabc783a000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788643132.648778:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9cacf57399c0) 00000020:00000080:0.0:1788643132.648785:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788643132.648858:0:23488:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788643132.648865:0:23488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x119ccc6e683c3d94 00000020:00000080:0.0:1788643132.648962:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788643132.648968:0:23488:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788643132.648973:0:23488:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x119ccc6e683c3d9b 00080000:01000000:0.0:1788643132.648978:0:23488:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788643132.648981:0:23488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x119ccc6e683c3da2 00010000:00010000:1.0:1788643132.720351:0:23488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788643132.721278:0:23488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1788643132.721784:0:23488:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788643132.724912:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788643132.724924:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643132.724942:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643132.724949:0:23488:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788643132.724954:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643132.724960:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643132.724961:0:23488:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788643132.724965:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788643132.724970:0:23488:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:00000080:0.0:1788643132.724996:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788643132.725010:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9cacf5738000) 00000020:00000080:0.0:1788643132.725030:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788643132.725035:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788643132.725103:0:23488:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788643132.725110:0:23488:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788643132.725117:0:23488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x119ccc6e683c3db0 00010000:00080000:0.0:1788643132.725147:0:23488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cacfe59d800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788643132.726749:0:23488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788643132.733968:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788643132.733983:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788643132.734025:0:23488:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788643132.734044:0:23488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x119ccc6e683c3db7 00000100:00080000:2.0:1788643132.734053:0:23488:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788643132.734058:0:23488:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9cacfe59d800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643132.734090:0:23488:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7457800 x1875527696872704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788643132.734110:0:23488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788643132.734135:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788643132.734138:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788643132.734141:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788643132.734144:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:2.0:1788643132.734148:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788643132.734151:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cabc89e7800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643132.734164:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7454380 x1875527696872832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788643132.734173:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788643132.734176:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788643132.734186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788643132.734189:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788643132.734271:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788643132.734275:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643132.734277:0:23488:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788643132.734279:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788643132.734282:0:23488:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788643132.734283:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788643132.734284:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788643132.734286:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788643132.734288:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643132.734289:0:23488:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788643132.734291:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788643132.734295:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643132.734296:0:23488:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788643132.734300:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788643132.734328:0:23488:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788643132.734340:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788643132.734343:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643132.734344:0:23488:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788643132.734346:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788643132.734348:0:23488:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788643132.734349:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788643132.734350:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788643132.734352:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788643132.734353:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643132.734355:0:23488:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788643132.734357:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788643132.734360:0:23488:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788643132.734363:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643132.734364:0:23488:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788643132.734366:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788643132.734398:0:23488:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:2.0:1788643132.734422:0:23488:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788643132.734425:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788643132.734437:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9cacf6cf3380) 00000020:00000080:2.0:1788643132.734448:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788643132.734454:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788643132.734521:0:23488:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788643132.734528:0:23488:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788643132.734534:0:23488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x119ccc6e683c3dc5 00010000:00080000:2.0:1788643132.734564:0:23488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cacc3be4800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:2.0:1788643132.734775:0:23488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788643132.735048:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875527696872960:0@lo:400:kworker.0 00000100:00100000:1.0:1788643132.735105:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643132.735313:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696872960 00000100:00100000:2.0:1788643132.735320:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696872960 00000100:00100000:2.0:1788643132.735365:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788643132.735375:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875527696872960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643132.735445:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875527696872960:12345-0@lo:400:kworker.0 Request processed in 71us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643132.735451:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788643132.736012:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cabc7457b80 x1875527696872960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643132.736025:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875527696872960:0@lo:400:kworker.0 00000040:01000000:2.0:1788643132.736660:0:23488:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788643132.737056:0:23488:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788643132.738976:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696872704:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788643132.739046:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.739098:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696872832:0@lo:38:kworker.0 00000100:00100000:0.0:1788643132.739121:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.739161:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696872704 00000100:00100000:0.0:1788643132.739168:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696872704 00000100:00100000:0.0:1788643132.739190:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696872832 00000100:00100000:0.0:1788643132.739193:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696872832 00000100:00100000:0.0:1788643132.739203:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788643132.739210:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875527696872704:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788643132.739233:0:22758:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 613 last 0 00000020:00000080:0.0:1788643132.739409:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x119ccc6e683c3dcc 00000004:00100000:0.0:1788643132.739422:0:22758:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788643132.739428:0:22758:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:2.0:1788643132.742871:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788643132.745367:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788643132.745605:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788643132.746138:0:23493:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788643132.746142:0:23493:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788643132.746907:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788643132.746996:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788643132.747035:0:23488:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788643132.747055:0:23488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x119ccc6e683c3dd3 00000100:00080000:2.0:1788643132.747064:0:23488:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788643132.747075:0:23488:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9cacc3be4800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643132.747108:0:23488:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7454e00 x1875527696873088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788643132.747168:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696873088:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788643132.747220:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527696873088 offset 0 length 520: 4 00000100:00080000:2.0:1788643132.747662:0:23488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788643132.747695:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643132.747699:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643132.747702:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643132.747704:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788643132.747717:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788643132.747721:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643132.747722:0:23488:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788643132.747725:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788643132.747728:0:23488:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788643132.747730:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788643132.747731:0:23488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788643132.747733:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788643132.747735:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643132.747736:0:23488:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788643132.747739:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788643132.747742:0:23488:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788643132.747745:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643132.747747:0:23488:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788643132.747749:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788643132.747753:0:23488:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.118@tcp to nid 0x20000c0a8ce76 (192.168.206.118@tcp) 00000020:01000000:3.0:1788643132.748006:0:23488:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788643132.748085:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788643132.748097:0:23488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9cabc7c38000) 00000020:00000080:3.0:1788643132.748112:0:23488:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788643132.748118:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788643132.748185:0:23488:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788643132.748192:0:23488:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788643132.748197:0:23488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x119ccc6e683c3de1 00010000:00080000:3.0:1788643132.748537:0:23488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cacc3245000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:3.0:1788643132.748813:0:23488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788643132.748874:0:23488:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788643132.748888:0:23488:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1788643132.749846:0:22758:0:(import.c:65:import_set_state_nolock()) ffff9cabc76c0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788643132.750037:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875527696872704:12345-0@lo:38:llog_process_th.0 Request processed in 10824us (10989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643132.750047:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788643132.750074:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788643132.750080:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875527696872832:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788643132.750121:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875527696872832:12345-0@lo:38:kworker.0 Request processed in 41us (10999us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788643132.750127:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788643132.751099:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788643132.751109:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788643132.751116:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788643132.751121:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788643132.751124:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacfe59d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788643132.751143:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696872704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788643132.751159:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788643132.751163:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788643132.751166:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788643132.751175:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696872832:0@lo:38:kworker.0 00000100:00100000:0.0:1788643132.751226:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788643132.751746:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696873216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788643132.751791:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788643132.752080:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788643132.752170:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696873216 00000100:00100000:1.0:1788643132.752177:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696873216 00000100:00100000:1.0:1788643132.752270:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788643132.752279:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875527696873216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788643132.752307:0:22757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788643132.752315:0:22758:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788643132.752322:0:22758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788643132.752354:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875527696873216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643132.752361:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788643132.752371:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696873216:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788643132.753228:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788643132.753435:0:23488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1788643132.754686:0:23496:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788643132.754693:0:23496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788643132.755628:0:23488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788643132.755640:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788643132.755683:0:23488:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788643132.755703:0:23488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x119ccc6e683c3de8 00000100:00080000:3.0:1788643132.755713:0:23488:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788643132.755718:0:23488:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cacc3245000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788643132.755749:0:23488:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc88eaa00 x1875527696873344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788643132.755774:0:23488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788643132.756071:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643132.756076:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643132.756078:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643132.756081:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788643132.756124:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696873344:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788643132.756192:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643132.756197:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.756198:0:23488:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788643132.756214:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788643132.756218:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.756220:0:23488:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788643132.756223:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788643132.756224:0:23488:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788643132.756226:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643132.756229:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.756230:0:23488:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788643132.756233:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000400:00000100:2.0:1788643132.756518:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527696873344 offset 0 length 520: 4 00000020:00000080:3.0:1788643132.756576:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.756579:0:23488:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788643132.756585:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788643132.756616:0:23488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643132.756619:0:23488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.756620:0:23488:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788643132.756624:0:23488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:1.0:1788643132.756781:0:23484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788643132.756809:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788643132.756829:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3d6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d71 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.756840:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc2811400/0x119ccc6e683c3d6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3d71 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788643132.756848:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cabc783a000 from 1 10000000:01000000:1.0:1788643132.756851:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788643132.756876:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.756885:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.756895:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643132.756910:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696873472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788643132.757114:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643132.757146:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6fc63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788643132.757196:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696873472 00000100:00100000:2.0:1788643132.757203:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696873472 00000100:00100000:2.0:1788643132.757341:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788643132.757351:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+15:23484:x1875527696873472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643132.757362:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643132.757374:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3df6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3def expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.757660:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3def expref: 16 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.757671:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3def expref: 16 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643132.757680:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacc2811a00, rc 0) 00000100:00100000:2.0:1788643132.757724:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+16:23484:x1875527696873472:12345-0@lo:101:mount.lustre.0 Request processed in 375us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643132.757731:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788643132.757852:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696873472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788643132.757866:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.757882:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643132.758450:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696873600:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788643132.758501:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643132.758532:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6fc63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788643132.758552:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696873600 00000100:00100000:2.0:1788643132.758563:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696873600 00000100:00100000:2.0:1788643132.758604:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788643132.758611:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+16:23484:x1875527696873600:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788643132.758625:0:22744:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788643132.758641:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788643132.758649:0:22744:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788643132.758726:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+16:23484:x1875527696873600:12345-0@lo:256:mount.lustre.0 Request processed in 115us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643132.758734:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788643132.758867:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696873600:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788643132.759620:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788643132.759643:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.759653:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788643132.759660:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cabc783a000 from 1 10000000:01000000:1.0:1788643132.759662:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788643132.759686:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.759693:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.759700:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643132.759714:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696873728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788643132.759747:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643132.759785:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6fc63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643132.759799:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696873728 00000100:00100000:3.0:1788643132.759806:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696873728 00000100:00100000:3.0:1788643132.759853:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788643132.759862:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+16:23484:x1875527696873728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788643132.759873:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643132.759885:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cad02174a00/0x119ccc6e683c3e04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3dfd expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.759906:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cad02174a00/0x119ccc6e683c3e04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3dfd expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.759916:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cad02174a00/0x119ccc6e683c3e04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3dfd expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.759924:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cad02174a00, rc 0) 00000100:00100000:3.0:1788643132.759979:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+17:23484:x1875527696873728:12345-0@lo:101:mount.lustre.0 Request processed in 119us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.759993:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788643132.760027:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696873728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788643132.760041:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.760049:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788643132.761082:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1788643132.761463:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788643132.761630:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788643132.761652:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1788643132.761665:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1788643132.761676:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1788643132.761689:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1788643132.761716:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1788643132.761731:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1788643132.761744:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1788643132.761757:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788643132.761768:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1788643132.761780:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1788643132.761891:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1788643132.761899:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1788643132.762029:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696873856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788643132.762074:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643132.762173:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6fc6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788643132.762213:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696873856 00000100:00100000:2.0:1788643132.762219:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696873856 00000100:00100000:2.0:1788643132.762306:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788643132.762315:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+17:23484:x1875527696873856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643132.762791:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+17:23484:x1875527696873856:12345-0@lo:501:mount.lustre.0 Request processed in 477us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643132.762809:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788643132.763219:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696873856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788643132.763264:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696873984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788643132.763306:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643132.763461:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6fc6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788643132.763794:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696873984 00000100:00100000:2.0:1788643132.763800:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696873984 00000100:00100000:2.0:1788643132.763920:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788643132.763943:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:23484:x1875527696873984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788643132.764039:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:23484:x1875527696873984:12345-0@lo:503:mount.lustre.0 Request processed in 111us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643132.764046:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788643132.764135:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696873984:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788643132.764543:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788643132.764615:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874112:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643132.764652:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.764684:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfe900 going to sleep for 11 seconds 00000100:00100000:2.0:1788643132.764739:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696874112 00000100:00100000:2.0:1788643132.764744:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696874112 00000100:00100000:2.0:1788643132.764767:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788643132.764773:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:23484:x1875527696874112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788643132.764850:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:23484:x1875527696874112:12345-0@lo:502:mount.lustre.0 Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643132.764856:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788643132.765046:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788643132.765193:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788643132.765227:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1788643132.765257:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1788643132.765271:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1788643132.765283:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1788643132.765293:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1788643132.765304:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1788643132.765315:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1788643132.765328:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788643132.765341:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1788643132.765358:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1788643132.765394:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643132.765532:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.765566:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfe900 going to sleep for 11 seconds 00000100:00100000:2.0:1788643132.765620:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696874240 00000100:00100000:2.0:1788643132.765625:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696874240 00000100:00100000:2.0:1788643132.765663:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788643132.765669:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:23484:x1875527696874240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788643132.765743:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:23484:x1875527696874240:12345-0@lo:502:mount.lustre.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643132.765749:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788643132.765897:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788643132.765951:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1788643132.765960:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788643132.766908:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788643132.766917:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.766920:0:23498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788643132.766926:0:23498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cabc783a000 00000020:00000080:3.0:1788643132.767445:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788643132.767454:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643132.767457:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.767458:0:23498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788643132.767461:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788643132.767464:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.767465:0:23498:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788643132.767469:0:23498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cabc783a000 00000020:00000080:3.0:1788643132.767471:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788643132.767520:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643132.767524:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.767525:0:23498:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788643132.767527:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788643132.767530:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.767531:0:23498:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788643132.767534:0:23498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cabc783a000 00000020:00000080:3.0:1788643132.767536:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788643132.767555:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643132.767558:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.767559:0:23498:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788643132.767561:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788643132.767564:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.767566:0:23498:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788643132.767570:0:23498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cabc783a000 00000020:00000080:3.0:1788643132.767572:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788643132.767597:0:23498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788643132.767600:0:23498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788643132.767608:0:23498:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788643132.767612:0:23498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1788643132.767999:0:23484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788643132.768024:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788643132.769057:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643132.769071:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643132.769138:0:23484:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788643132.769142:0:23484:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cabc783a000 10000000:01000000:0.0:1788643132.769145:0:23484:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cabc783a000 10000000:01000000:0.0:1788643132.769149:0:23484:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788643132.769154:0:23484:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cabc783a000 from 1 10000000:01000000:0.0:1788643132.769157:0:23484:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788643132.769187:0:23484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa000/0x119ccc6e683c3e0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643132.769196:0:23484:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa000/0x119ccc6e683c3e0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643132.769206:0:23484:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa000/0x119ccc6e683c3e0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643132.769228:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788643132.769300:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.769348:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788643132.771727:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696874368 00000100:00100000:3.0:1788643132.771738:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696874368 00000100:00100000:3.0:1788643132.771781:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788643132.771789:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:23484:x1875527696874368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788643132.771803:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643132.771820:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cad02175a00/0x119ccc6e683c3e12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3e0b expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.771845:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cad02175a00/0x119ccc6e683c3e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3e0b expref: 18 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.771856:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cad02175a00/0x119ccc6e683c3e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3e0b expref: 18 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.771864:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cad02175a00, rc 0) 00000100:00100000:3.0:1788643132.771946:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696874368:12345-0@lo:101:mount.lustre.0 Request processed in 158us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.771952:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788643132.772324:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788643132.772342:0:23484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa000/0x119ccc6e683c3e0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e12 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643132.772352:0:23484:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa000/0x119ccc6e683c3e0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3e12 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788643132.780518:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1788643132.780767:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788643132.781057:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1788643132.781088:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1788643132.781103:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1788643132.781115:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1788643132.781127:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1788643132.781140:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1788643132.781153:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1788643132.781165:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1788643132.781177:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1788643132.781190:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1788643132.781203:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1788643132.781216:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1788643132.781227:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1788643132.781254:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1788643132.781272:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1788643132.781283:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1788643132.781295:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1788643132.781307:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1788643132.781320:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1788643132.781333:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1788643132.781346:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1788643132.781359:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1788643132.781371:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1788643132.781404:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1788643132.781992:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1788643132.782014:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1788643132.782029:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1788643132.782042:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1788643132.782056:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1788643132.782084:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1788643132.782099:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1788643132.782110:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1788643132.782122:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1788643132.782132:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1788643132.782156:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1788643132.782171:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1788643132.782183:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1788643132.782194:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1788643132.782205:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1788643132.782215:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1788643132.782226:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1788643132.782237:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1788643132.782250:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1788643132.782263:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1788643132.782277:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1788643132.782304:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1788643132.782319:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1788643132.782331:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1788643132.783120:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1788643132.783150:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1788643132.783171:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1788643132.783177:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1788643132.783266:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643132.783325:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.783366:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfe540 going to sleep for 11 seconds 00000100:00100000:0.0:1788643132.786246:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696874496 00000100:00100000:0.0:1788643132.786259:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696874496 00000100:00100000:0.0:1788643132.786315:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788643132.786327:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696874496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643132.786757:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696874496:12345-0@lo:501:mount.lustre.0 Request processed in 432us (3430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643132.786767:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788643132.786888:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788643132.788566:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788643132.788633:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643132.788673:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6fc6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788643132.789079:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696874624 00000100:00100000:3.0:1788643132.789087:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696874624 00000100:00100000:3.0:1788643132.789137:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788643132.789145:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696874624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788643132.789258:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696874624:12345-0@lo:503:mount.lustre.0 Request processed in 113us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.789267:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788643132.789445:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874624:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788643132.790180:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788643132.790248:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874752:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643132.790299:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.790374:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788643132.790521:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696874752 00000100:00100000:1.0:1788643132.790526:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696874752 00000100:00100000:1.0:1788643132.790595:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788643132.790604:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696874752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788643132.790705:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696874752:12345-0@lo:502:mount.lustre.0 Request processed in 102us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643132.790713:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788643132.790780:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874752:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788643132.791005:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788643132.791033:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1788643132.791049:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1788643132.791062:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1788643132.791081:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1788643132.791098:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1788643132.791114:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1788643132.791145:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1788643132.791166:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788643132.791182:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1788643132.791199:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1788643132.791219:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1788643132.791239:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1788643132.791261:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1788643132.791278:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1788643132.791293:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1788643132.791307:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1788643132.791322:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1788643132.791336:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1788643132.791356:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1788643132.791371:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1788643132.791448:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1788643132.791466:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1788643132.791493:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1788643132.791510:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1788643132.791542:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1788643132.791555:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1788643132.791569:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1788643132.791585:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1788643132.791602:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1788643132.791617:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1788643132.791633:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1788643132.791647:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1788643132.791662:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1788643132.791677:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1788643132.791697:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1788643132.791718:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1788643132.791737:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1788643132.791751:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1788643132.791776:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1788643132.791793:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1788643132.791808:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1788643132.791822:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1788643132.791835:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1788643132.791848:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1788643132.791862:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1788643132.791876:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1788643132.791891:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1788643132.791947:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643132.792000:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643132.792373:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696874880 00000100:00100000:3.0:1788643132.792391:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696874880 00000100:00100000:3.0:1788643132.792439:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788643132.792448:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696874880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788643132.792540:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696874880:12345-0@lo:502:mount.lustre.0 Request processed in 94us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.792548:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788643132.792851:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788643132.792871:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696874880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788643132.793346:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1788643132.793371:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1788643132.793894:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696875008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643132.794080:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.794146:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788643132.794181:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696875008 00000100:00100000:3.0:1788643132.794187:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696875008 00000100:00100000:3.0:1788643132.794264:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788643132.794274:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696875008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788643132.794377:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696875008:12345-0@lo:502:mount.lustre.0 Request processed in 105us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.794411:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788643132.794500:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696875008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788643132.794552:0:23484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1788643132.794561:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788643132.795771:0:23504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788643132.795786:0:23504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9cacf6cf4d40) 00000020:00000080:2.0:1788643132.795806:0:23504:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788643132.795897:0:23504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cabc783a000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788643132.795901:0:23504:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cabc783a000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788643132.795905:0:23504:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cabc783a000 3 00010000:00080000:2.0:1788643132.795953:0:23504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cacc835b000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.118@tcp at head 00010000:00010000:2.0:1788643132.797878:0:23504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788643132.798069:0:23504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788643132.798110:0:23504:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788643132.798125:0:23504:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x119ccc6e683c3e20 00000100:00080000:2.0:1788643132.798135:0:23504:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788643132.798141:0:23504:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9cacc835b000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643132.798174:0:23504:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7454380 x1875527696875136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788643132.798217:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875527696875136:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788643132.798290:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788643132.798350:0:23504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788643132.798402:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788643132.798408:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788643132.798410:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788643132.798534:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696875136 00000100:00100000:1.0:1788643132.798543:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696875136 00000100:00100000:1.0:1788643132.798575:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788643132.798582:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875527696875136:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788643132.798605:0:22754:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 614 last 0 00000020:00000080:1.0:1788643132.798634:0:22754:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x119ccc6e683c3e27 00000004:00100000:1.0:1788643132.798647:0:22754:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788643132.798674:0:22754:0:(import.c:65:import_set_state_nolock()) ffff9cacfcf98800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788643132.798725:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875527696875136:12345-0@lo:38:llog_process_th.0 Request processed in 141us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643132.798733:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788643132.798745:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cabc7454380 x1875527696875136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788643142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643132.798756:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788643132.798763:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788643132.798781:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788643132.798785:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788643132.798788:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc835b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788643132.798793:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875527696875136:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788643132.799361:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cabc89e7800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643132.799498:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc999a300 x1875527696875264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788643132.799518:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643132.799523:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643132.799525:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643132.799528:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643132.799569:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643132.799573:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643132.799576:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643132.799579:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788643132.799597:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875527696875392:0@lo:400:kworker.0 00000100:00100000:0.0:1788643132.799636:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.799684:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696875520:0@lo:400:kworker.0 00000100:00100000:0.0:1788643132.799724:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.799763:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696875392 00000100:00100000:0.0:1788643132.799767:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696875392 00000100:00100000:1.0:1788643132.799897:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696875264:0@lo:38:kworker.0 00000100:00100000:1.0:1788643132.800107:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643132.800144:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696875520 00000100:00100000:1.0:1788643132.800154:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696875520 00000100:00100000:1.0:1788643132.800182:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696875264 00000100:00100000:1.0:1788643132.800185:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696875264 00000100:00100000:1.0:1788643132.800197:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788643132.800205:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875527696875520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643132.800251:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875527696875520:12345-0@lo:400:kworker.0 Request processed in 46us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643132.800259:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788643132.800281:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788643132.800286:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875527696875264:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788643132.800330:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875527696875264:12345-0@lo:38:kworker.0 Request processed in 43us (222us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788643132.800336:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788643132.800375:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696875520:0@lo:400:kworker.0 00000100:00100000:0.0:1788643132.800519:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788643132.800530:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875527696875392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643132.800574:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875527696875392:12345-0@lo:400:kworker.0 Request processed in 48us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643132.800583:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788643132.800634:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cacc999b100 x1875527696875392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643132.800644:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875527696875392:0@lo:400:kworker.0 00000100:00080000:1.0:1788643132.800854:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e7800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788643132.800859:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788643132.800862:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696875264:0@lo:38:kworker.0 00000040:00080000:2.0:1788643132.801631:0:23504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1788643132.801693:0:23484:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788643132.801729:0:23484:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788643132.801748:0:23484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa000/0x119ccc6e683c3e0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e12 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643132.801761:0:23484:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa000/0x119ccc6e683c3e0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e12 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788643132.802230:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788643132.802233:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788643132.802234:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788643132.802235:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788643132.802236:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788643132.802238:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788643132.802239:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788643132.802240:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788643132.802242:0:23484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788643132.802246:0:23484:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788643132.802248:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788643132.802254:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788643132.802255:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788643132.802256:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788643132.802257:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788643132.802258:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788643132.802259:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788643132.802259:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788643132.802260:0:23484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788643132.802281:0:23484:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788643132.802296:0:23484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696875648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788643132.802347:0:23484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.805832:0:23484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfe900 going to sleep for 11 seconds 00000100:00100000:1.0:1788643132.809073:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696875648 00000100:00100000:1.0:1788643132.809087:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696875648 00000100:00100000:1.0:1788643132.809141:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788643132.809150:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696875648:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788643132.809179:0:22746:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788643132.809248:0:22746:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788643132.812074:0:22732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788643132.812180:0:22746:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788643132.812235:0:22746:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788643132.812323:0:22768:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788643132.812328:0:22768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788643132.812357:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.812375:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cacfe7aa600/0x119ccc6e683c3d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3d2b expref: 18 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.812457:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3def expref: 18 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.812464:0:22768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.812500:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3def expref: 18 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.812515:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3df6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3def expref: 18 pid: 22746 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643132.812530:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696875776:0@lo:104: 00000100:00100000:1.0:1788643132.812590:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788643132.812688:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cacfe7aa600/0x119ccc6e683c3d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3d2b expref: 18 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643132.812698:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cacfe7aa600/0x119ccc6e683c3d32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3d2b expref: 18 pid: 22746 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643132.812707:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696875904:0@lo:104: 00000100:00100000:1.0:1788643132.812727:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643132.812853:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6fc69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643132.812889:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696875776 00000100:00100000:3.0:1788643132.812895:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696875776 00000100:00100000:3.0:1788643132.812926:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696875904 00000100:00100000:3.0:1788643132.812939:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696875904 00000100:00100000:3.0:1788643132.812956:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788643132.812965:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+4:22768:x1875527696875776:12345-0@lo:104: 00010000:00010000:3.0:1788643132.812976:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813067:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788643132.813074:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+4:22768:x1875527696875776:12345-0@lo:104: Request processed in 111us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.813080:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788643132.813096:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788643132.813102:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+3:22768:x1875527696875904:12345-0@lo:104: 00010000:00010000:3.0:1788643132.813116:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813147:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788643132.813153:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+3:22768:x1875527696875904:12345-0@lo:104: Request processed in 51us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.813158:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788643132.813176:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788643132.813181:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813187:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0031c00 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:3.0:1788643132.813191:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813199:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788643132.813206:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643132.813211:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788643132.813234:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813240:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788643132.813256:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813263:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc0031c00/0x119ccc6e683c3def lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3df6 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813282:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788643132.813286:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813292:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab200 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:3.0:1788643132.813295:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813302:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788643132.813308:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643132.813314:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788643132.813330:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813336:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788643132.813348:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813354:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab200/0x119ccc6e683c3d2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3d32 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.813371:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643132.813373:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643132.813375:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643132.813416:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788643132.813434:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696876032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788643132.813462:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643132.813536:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696875776:0@lo:104: 00000100:00100000:1.0:1788643132.813545:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696875904:0@lo:104: 00010000:00010000:1.0:1788643132.813593:0:22768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643132.813708:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+18:23484:x1875527696875648:12345-0@lo:253:mount.lustre.0 Request processed in 4559us (11360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643132.813717:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1788643132.813883:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643132.813904:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696876160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643132.813952:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643132.814056:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696876032 00000100:00100000:3.0:1788643132.814062:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696876032 00010000:00010000:3.0:1788643132.814082:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3df6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3def expref: 18 pid: 22746 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643132.814111:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696876160 00000100:00100000:3.0:1788643132.814115:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696876160 00010000:00010000:3.0:1788643132.814125:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cacfe7aa600/0x119ccc6e683c3d32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3d2b expref: 19 pid: 22746 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643132.814138:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788643132.814145:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da540a41-a984-4ac4-89dc-6d833e36a776+19:3642:x1875527696876032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788643132.814155:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788643132.814160:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3df6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3def expref: 19 pid: 22746 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.814170:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3def expref: 19 pid: 22746 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.814184:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3df6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3def expref: 19 pid: 22746 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.814195:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643132.814262:0:22739:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788643132.814270:0:22739:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788643132.815504:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da540a41-a984-4ac4-89dc-6d833e36a776+18:3642:x1875527696876032:12345-0@lo:103:ldlm_bl.0 Request processed in 1353us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.815515:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788643132.815546:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788643132.815558:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da540a41-a984-4ac4-89dc-6d833e36a776+17:3644:x1875527696876160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788643132.815578:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788643132.815586:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cacfe7aa600/0x119ccc6e683c3d32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3d2b expref: 17 pid: 22746 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815599:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cacfe7aa600/0x119ccc6e683c3d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3d2b expref: 17 pid: 22746 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815613:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacfe7aa600/0x119ccc6e683c3d32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3d2b expref: 17 pid: 22746 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815626:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815634:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788643132.815652:0:22737:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006594089s 00010000:00010000:3.0:1788643132.815656:0:22737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815663:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815669:0:22737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815675:0:22737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815681:0:22737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0031200 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643132.815684:0:22737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815698:0:22737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815714:0:22737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815724:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788643132.815756:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da540a41-a984-4ac4-89dc-6d833e36a776+16:3644:x1875527696876160:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643132.815763:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788643132.815805:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696876032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788643132.815834:0:22768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815843:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643132.815850:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c3e2e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643132.817287:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696876160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643132.817329:0:23484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:23484:1875527696875648:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788643132.817342:0:23484:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788643132.817345:0:23484:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788643132.817353:0:23484:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788643132.817354:0:23484:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788643132.817355:0:23484:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788643132.817357:0:23484:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788643132.817358:0:23484:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788643132.817359:0:23484:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788643132.817361:0:23484:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788643132.817363:0:23484:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788643132.817374:0:23484:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1788643132.821603:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788643132.821849:0:23511:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788643132.821998:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1788643132.823179:0:23511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788643132.825474:0:23511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788643132.825545:0:23511:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000020:00080000:1.0:1788643132.825808:0:23510:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788643132.825812:0:23510:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788643132.826136:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788643132.826170:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788643132.826527:0:23512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23512:1875527696876288:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788643132.826593:0:23512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643132.826665:0:23512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfe780 going to sleep for 11 seconds 00000004:00000080:2.0:1788643132.827168:0:23484:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788643132.827178:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788643132.827227:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788643132.828342:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1788643132.829080:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696876288 00000100:00100000:1.0:1788643132.829089:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696876288 00000040:00080000:2.0:1788643132.829190:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788643132.829223:0:23484:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788643132.829316:0:23484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788643132.830188:0:23484:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:0.0:1788643132.831330:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788643132.831342:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23512:x1875527696876288:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788643132.831488:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23512:x1875527696876288:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 150us (4894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643132.831496:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788643132.831632:0:23512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23512:1875527696876288:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788643132.831663:0:23512:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788643132.831703:0:23512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23512:1875527696876416:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788643132.831745:0:23512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643132.831943:0:23512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cace7032c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788643132.832090:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696876416 00000100:00100000:1.0:1788643132.832097:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696876416 00000100:00100000:1.0:1788643132.832124:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788643132.832131:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23512:x1875527696876416:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788643132.832238:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23512:x1875527696876416:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 107us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643132.832245:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788643132.832315:0:23512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23512:1875527696876416:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788643132.832370:0:23512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23512:1875527696876544:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788643132.832449:0:23512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643132.832463:0:23512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cace70323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643132.832569:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696876544 00000100:00100000:1.0:1788643132.832574:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696876544 00000100:00100000:1.0:1788643132.832600:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788643132.832607:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23512:x1875527696876544:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788643132.832643:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23512:x1875527696876544:12345-0@lo:900:lod0001_rec0000.0 Request processed in 36us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643132.832648:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00000004:2.0:1788643132.833240:0:23484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:2.0:1788643132.833309:0:23512:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cabc7454380 x1875527696876544/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788643148 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643132.833322:0:23512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23512:1875527696876544:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788643132.833365:0:23512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23512:1875527696876672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788643132.833773:0:23512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643132.833837:0:23512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc672bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788643132.833867:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696876672 00000100:00100000:1.0:1788643132.833873:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696876672 00000100:00100000:1.0:1788643132.833958:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788643132.833967:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23512:x1875527696876672:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788643132.834059:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23512:x1875527696876672:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643132.834066:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788643132.834115:0:23512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23512:1875527696876672:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788643132.834155:0:23512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788643132.836149:0:23512:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788643132.836221:0:23512:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788643132.836226:0:23512:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788643132.846194:0:23484:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788643132.846225:0:23484:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa83bc1997988 00100000:10000000:2.0:1788643132.846232:0:23484:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788643132.847146:0:23484:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788643132.847174:0:23484:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788643132.847191:0:23484:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788643132.847211:0:23484:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788643132.848109:0:23484:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788643132.848312:0:23484:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788643132.939512:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00010000:00010000:3.0:1788643133.579660:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788643133.837145:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788643133.900015:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788643133.964447:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 10000000:01000000:3.0:1788643134.030432:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788643134.030440:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cabc783a000 from 12 10000000:01000000:3.0:1788643134.030446:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788643134.030488:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643134.030512:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643134.030523:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643134.030549:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696876800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788643134.030620:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643134.030656:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc750b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788643134.030677:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696876800 00000100:00100000:3.0:1788643134.030683:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696876800 00000100:00100000:3.0:1788643134.030739:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788643134.030749:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+16:22749:x1875527696876800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643134.030764:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643134.030778:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cad02174c00/0x119ccc6e683c3e3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3e35 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643134.030800:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cad02174c00/0x119ccc6e683c3e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3e35 expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643134.030810:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cad02174c00/0x119ccc6e683c3e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3e35 expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643134.030819:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cad02174c00, rc 0) 00000100:00100000:3.0:1788643134.030855:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+17:22749:x1875527696876800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643134.030861:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788643134.033623:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696876800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643134.033648:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643134.033660:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643134.033725:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696876928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788643134.033783:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643134.033821:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc750b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788643134.034393:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696876928 00000100:00100000:1.0:1788643134.034400:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696876928 00000100:00100000:1.0:1788643134.035240:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788643134.035268:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:22749:x1875527696876928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788643134.035291:0:22746:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788643134.035310:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788643134.035314:0:22746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788643134.035452:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:22749:x1875527696876928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 194us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643134.035460:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788643134.035583:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696876928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788643134.035637:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788643134.035645:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643134.035654:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643134.035663:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788643134.035666:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cabc94a4800 from 12 10000000:01000000:0.0:1788643134.035669:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788643134.035695:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643134.035704:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643134.035713:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643134.035743:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696877056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788643134.035773:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643134.035805:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfe180 going to sleep for 11 seconds 00000100:00100000:3.0:1788643134.036167:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696877056 00000100:00100000:3.0:1788643134.036174:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696877056 00000100:00100000:3.0:1788643134.036361:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788643134.036370:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+17:22749:x1875527696877056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643134.036398:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643134.036411:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cad02174600/0x119ccc6e683c3e4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3e43 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643134.036433:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cad02174600/0x119ccc6e683c3e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3e43 expref: 18 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643134.036444:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cad02174600/0x119ccc6e683c3e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3e43 expref: 18 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643134.036453:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cad02174600, rc 0) 00000100:00100000:3.0:1788643134.036487:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:22749:x1875527696877056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643134.036494:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788643134.036749:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696877056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788643134.036763:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643134.036773:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643134.036818:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696877184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788643134.036851:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643134.036877:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788643134.037457:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696877184 00000100:00100000:0.0:1788643134.037464:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696877184 00000100:00100000:0.0:1788643134.037495:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788643134.037503:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+18:22749:x1875527696877184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788643134.037519:0:22744:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788643134.037533:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788643134.037536:0:22744:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788643134.037628:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+18:22749:x1875527696877184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643134.037636:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788643134.037672:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696877184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788643134.037710:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788643134.037720:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643134.037728:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643134.605430:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788643134.860661:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788643134.987446:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00010000:00010000:1.0:1788643135.631298:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643136.011540:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00010000:00010000:1.0:1788643136.654810:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788643136.675319:0:23754:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788643137.035464:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00000020:00000004:0.0:1788643137.584641:0:23806:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788643137.584832:0:23806:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788643137.677499:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643138.064002:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 0 seconds 00000100:00080000:1.0:1788643138.255218:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788643138.255223:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788643138.255227:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e7800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788643138.255238:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cabc89e7800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788643138.255259:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7ece300 x1875527696877440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788643138.255276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788643138.255286:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788643138.255288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788643138.255291:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788643138.255320:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788643138.255323:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788643138.255326:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788643138.255328:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788643138.255358:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696877312:0@lo:400:kworker.0 00000100:00100000:1.0:1788643138.255445:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643138.255494:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788643138.255500:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875527696877824:0@lo:400:kworker.0 00000100:00100000:1.0:1788643138.255531:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643138.255563:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696877440:0@lo:38:kworker.0 00000100:00100000:1.0:1788643138.255586:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643138.255615:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875527696877568:0@lo:400:kworker.0 00000100:00100000:1.0:1788643138.255636:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643138.255654:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788643138.255659:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696877696:0@lo:400:kworker.0 00000100:00100000:1.0:1788643138.255682:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643138.255714:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696877312 00000100:00100000:1.0:1788643138.255721:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696877312 00000100:00100000:1.0:1788643138.255765:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788643138.255774:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+18:3645:x1875527696877312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643138.255836:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+18:3645:x1875527696877312:12345-0@lo:400:kworker.0 Request processed in 63us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643138.255844:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788643138.255876:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696877824 00000100:00100000:1.0:1788643138.255880:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696877824 00000100:00100000:1.0:1788643138.255915:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696877568 00000100:00100000:1.0:1788643138.255919:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696877568 00000100:00100000:1.0:1788643138.255932:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788643138.255938:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875527696877824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643138.255967:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875527696877824:12345-0@lo:400:kworker.0 Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643138.255978:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788643138.255990:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788643138.255995:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875527696877568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643138.256024:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875527696877568:12345-0@lo:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643138.256029:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788643138.256043:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696877440 00000100:00100000:1.0:1788643138.256047:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696877440 00000100:00100000:1.0:1788643138.256073:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696877696 00000100:00100000:1.0:1788643138.256076:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696877696 00000100:00100000:1.0:1788643138.256090:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788643138.256095:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875527696877440:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788643138.256118:0:22757:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 619 last 0 00000020:00000080:1.0:1788643138.256149:0:22757:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x119ccc6e683c3e51 00000004:00100000:1.0:1788643138.256161:0:22757:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788643138.256166:0:22757:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1788643138.256244:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788643138.256252:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696877696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643138.256285:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696877696:12345-0@lo:400:kworker.0 Request processed in 34us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643138.256291:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788643138.256331:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696877696:0@lo:400:kworker.0 00010000:00080000:1.0:1788643138.256345:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cabc7ecd880 x1875527696877568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643138.256354:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875527696877568:0@lo:400:kworker.0 00010000:00080000:1.0:1788643138.256470:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cabc7ecc000 x1875527696877824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643138.256478:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875527696877824:0@lo:400:kworker.0 00000100:00100000:1.0:1788643138.256486:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696877312:0@lo:400:kworker.0 00000100:00100000:1.0:1788643138.258467:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788643138.258487:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696877952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788643138.258543:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643138.258679:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696877952 00000100:00100000:2.0:1788643138.258686:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696877952 00000100:00100000:2.0:1788643138.258733:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788643138.258741:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696877952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788643138.258770:0:23495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788643138.258819:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696877952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643138.258849:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788643138.259149:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696877952:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788643138.267350:0:22757:0:(import.c:65:import_set_state_nolock()) ffff9cabc7f61800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788643138.267473:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875527696877440:12345-0@lo:38:kworker.0 Request processed in 11375us (11884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643138.267484:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788643138.270835:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788643138.270850:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788643138.270856:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788643138.270859:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788643138.270889:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000005ff513a): req@ffff9cacc88e8700 x1875527696870144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643138.270922:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696877440:0@lo:38:kworker.0 00000100:00100000:2.0:1788643138.271017:0:22794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643138.271045:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788643138.271061:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696870144 00000100:00100000:2.0:1788643138.271067:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696870144 00000100:00100000:2.0:1788643138.271107:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788643138.271114:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22794:x1875527696870144:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788643138.271183:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22794:x1875527696870144:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 69us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643138.271190:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788643138.271217:0:22794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22794:1875527696870144:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788643138.271245:0:22794:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788643138.271283:0:22794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22794:1875527696878080:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788643138.271311:0:22794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643138.271326:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc672b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788643138.271339:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696878080 00000100:00100000:2.0:1788643138.271355:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696878080 00000100:00100000:2.0:1788643138.271401:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788643138.271408:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22794:x1875527696878080:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788643138.271495:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22794:x1875527696878080:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643138.271502:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788643138.271528:0:22794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22794:1875527696878080:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788643138.271584:0:22794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22794:1875527696878208:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788643138.271605:0:22794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643138.271619:0:22794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc672b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788643138.271630:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696878208 00000100:00100000:2.0:1788643138.271634:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696878208 00000100:00100000:2.0:1788643138.271656:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788643138.271663:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22794:x1875527696878208:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788643138.271705:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22794:x1875527696878208:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643138.271711:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788643138.271729:0:22794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22794:1875527696878208:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788643138.271761:0:22794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788643138.273700:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788643138.273716:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696878336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788643138.273768:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643138.273811:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696878336 00000100:00100000:3.0:1788643138.273817:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696878336 00000100:00100000:3.0:1788643138.273849:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788643138.273855:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875527696878336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788643138.273882:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788643138.273930:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875527696878336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643138.273936:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788643138.273973:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696878336:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788643138.281976:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788643138.282056:0:22794:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:2.0:1788643138.282062:0:22794:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1788643138.692741:0:23856:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788643138.692949:0:23856:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788643138.700970:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788643139.632755:0:23905:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfc1401f0 20000000:00000080:3.0:1788643139.632848:0:23905:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cacc62fb000 uarg=0000000000000000 20000000:01000000:3.0:1788643139.632960:0:23905:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788643139.632968:0:23905:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788643139.632973:0:23905:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788643139.634465:0:23906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788643139.634855:0:23905:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788643139.644993:0:23905:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788643139.645260:0:23905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643139.645280:0:23905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cacfe7aa200/0x119ccc6e683c3d01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3cfa expref: 17 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643139.645300:0:23905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cad02174a00/0x119ccc6e683c3e04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3dfd expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643139.645306:0:23905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643139.645344:0:23905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cad02174a00/0x119ccc6e683c3e04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3dfd expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643139.645359:0:23905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cad02174a00/0x119ccc6e683c3e04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3dfd expref: 17 pid: 22745 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643139.649329:0:23905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23905:1875527696878464:0@lo:104: 00000100:00100000:2.0:1788643139.649538:0:23905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788643139.649600:0:23905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cacfe7aa200/0x119ccc6e683c3d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3cfa expref: 17 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643139.649615:0:23905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cacfe7aa200/0x119ccc6e683c3d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3cfa expref: 17 pid: 22746 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643139.649624:0:23905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7456a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23905:1875527696878592:0@lo:104: 00000100:00100000:2.0:1788643139.649646:0:23905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643139.649669:0:23905:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc672b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788643139.650036:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696878464 00000100:00100000:3.0:1788643139.650044:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696878464 00000100:00100000:3.0:1788643139.650234:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696878592 00000100:00100000:3.0:1788643139.650250:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696878592 00000100:00100000:3.0:1788643139.650270:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788643139.650278:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7456680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+4:23905:x1875527696878464:12345-0@lo:104: 00010000:00010000:3.0:1788643139.650292:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643139.650996:0:23905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23905:1875527696878464:0@lo:104: 00010000:00010000:3.0:1788643139.651989:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788643139.652001:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7456680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+4:23905:x1875527696878464:12345-0@lo:104: Request processed in 1721us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643139.652010:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788643139.652038:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788643139.652049:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7457100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+3:23905:x1875527696878592:12345-0@lo:104: 00010000:00010000:3.0:1788643139.652064:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643139.652204:0:23905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7456a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23905:1875527696878592:0@lo:104: 00010000:00010000:2.0:1788643139.652227:0:23905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.652666:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788643139.652674:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.652682:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0031800 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643139.652687:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.652697:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643139.652705:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643139.652711:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788643139.652887:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.652915:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788643139.652944:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.652952:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc0031800/0x119ccc6e683c3dfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e04 expref: -99 pid: 23484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.652965:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643139.652968:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.652974:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0030600 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643139.652977:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.652985:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643139.652992:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643139.652997:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788643139.653038:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da540a41-a984-4ac4-89dc-6d833e36a776:3643:1875527696878720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788643139.653091:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788643139.653303:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788643139.653311:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7457100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+3:23905:x1875527696878592:12345-0@lo:104: Request processed in 1266us (3664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643139.653319:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788643139.653365:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696878720 00000100:00100000:3.0:1788643139.653372:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696878720 00010000:00010000:3.0:1788643139.653463:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cad02174a00/0x119ccc6e683c3e04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3dfd expref: 18 pid: 22745 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643139.653490:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788643139.653498:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7456a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+18:3643:x1875527696878720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788643139.653509:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788643139.653514:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cad02174a00/0x119ccc6e683c3e04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3dfd expref: 18 pid: 22745 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643139.653532:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cad02174a00/0x119ccc6e683c3e04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3dfd expref: 18 pid: 22745 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643139.653547:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cad02174a00/0x119ccc6e683c3e04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3dfd expref: 18 pid: 22745 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643139.653560:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788643139.653597:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7456a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+17:3643:x1875527696878720:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643139.653603:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788643139.653634:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da540a41-a984-4ac4-89dc-6d833e36a776:3643:1875527696878720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788643139.653974:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643139.658704:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.658720:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788643139.658771:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788643139.658792:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.658802:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc0030600/0x119ccc6e683c3cfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3d01 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.658836:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643139.658839:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643139.658841:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643139.661535:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696878848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643139.661612:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643139.662315:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696878848 00000100:00100000:1.0:1788643139.662324:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696878848 00010000:00010000:1.0:1788643139.662355:0:22738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cacfe7aa200/0x119ccc6e683c3d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3cfa expref: 17 pid: 22746 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643139.662619:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788643139.662629:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da540a41-a984-4ac4-89dc-6d833e36a776+17:3645:x1875527696878848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788643139.662644:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788643139.662650:0:22738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cacfe7aa200/0x119ccc6e683c3d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3cfa expref: 17 pid: 22746 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662660:0:22738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cacfe7aa200/0x119ccc6e683c3d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3cfa expref: 17 pid: 22746 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662677:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacfe7aa200/0x119ccc6e683c3d01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3cfa expref: 17 pid: 22746 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662691:0:22738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662699:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662715:0:22738:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662721:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662744:0:22738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662751:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662756:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc2811a00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643139.662760:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662785:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662805:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643139.662816:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788643139.662875:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da540a41-a984-4ac4-89dc-6d833e36a776+16:3645:x1875527696878848:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643139.662883:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788643139.662963:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696878848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788643139.663032:0:23905:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643139.663041:0:23905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643139.663047:0:23905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e58 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643139.735596:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643140.748985:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788643141.518985:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788643141.518992:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cabc783a000 from 13 10000000:01000000:2.0:1788643141.518997:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788643141.519050:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643141.519062:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643141.519073:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643141.519097:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696878976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788643141.519162:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643141.519214:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc7bb5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788643141.519573:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696878976 00000100:00100000:3.0:1788643141.519580:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696878976 00000100:00100000:3.0:1788643141.519631:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788643141.519649:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+16:22749:x1875527696878976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643141.519662:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643141.519675:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacf6d3dc00/0x119ccc6e683c3e66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3e5f expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643141.519705:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacf6d3dc00/0x119ccc6e683c3e66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3e5f expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643141.519714:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacf6d3dc00/0x119ccc6e683c3e66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3e5f expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643141.519722:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacf6d3dc00, rc 0) 00000100:00100000:3.0:1788643141.519766:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+17:22749:x1875527696878976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643141.519782:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788643141.519832:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696878976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643141.519846:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643141.519856:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643141.520160:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696879104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788643141.520320:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643141.520349:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc750bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788643141.520364:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696879104 00000100:00100000:3.0:1788643141.520369:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696879104 00000100:00100000:3.0:1788643141.520423:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788643141.520431:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:22749:x1875527696879104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788643141.520526:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:22749:x1875527696879104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643141.520534:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788643141.520567:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696879104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788643141.520825:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696879232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788643141.520953:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643141.521013:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc750bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788643141.535819:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696879232 00000100:00100000:2.0:1788643141.535846:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696879232 00000100:00100000:2.0:1788643141.536586:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788643141.536596:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:22749:x1875527696879232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788643141.536813:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+17:22749:x1875527696879232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (15859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643141.536822:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788643141.536843:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696879232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788643141.541447:0:23973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788643141.541823:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788643141.541846:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788643141.541855:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643141.541892:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643141.541903:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788643141.541905:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cabc94a4800 from 13 10000000:01000000:3.0:1788643141.541908:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788643141.541941:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643141.541949:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643141.541959:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643141.541982:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696879360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788643141.542046:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643141.542084:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc750b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788643141.542806:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696879360 00000100:00100000:2.0:1788643141.542815:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696879360 00000100:00100000:2.0:1788643141.542979:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788643141.542991:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+17:22749:x1875527696879360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788643141.543004:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643141.543018:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3e6d expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643141.543039:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3e6d expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643141.543049:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3e6d expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643141.543057:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacc2811a00, rc 0) 00000100:00100000:2.0:1788643141.544898:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+18:22749:x1875527696879360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1891us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643141.544908:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788643141.548941:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696879360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788643141.548971:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643141.548984:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643141.549086:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696879488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788643141.549144:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643141.549208:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc8c3ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788643141.549233:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696879488 00000100:00100000:0.0:1788643141.549239:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696879488 00000100:00100000:0.0:1788643141.549274:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788643141.549283:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:22749:x1875527696879488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788643141.549411:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:22749:x1875527696879488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643141.549419:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788643141.549456:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696879488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788643141.549482:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696879616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788643141.549519:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643141.549536:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc8c3ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788643141.549547:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696879616 00000100:00100000:0.0:1788643141.549551:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696879616 00000100:00100000:0.0:1788643141.549571:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788643141.549577:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+18:22749:x1875527696879616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788643141.549659:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+18:22749:x1875527696879616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643141.549666:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788643141.549713:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696879616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788643141.550348:0:23974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788643141.550429:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788643141.550443:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788643141.550452:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643141.550461:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643141.772502:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643142.347478:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643132/real 1788643132] req@ffff9cacc88eaa00 x1875527696873344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643142 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643142.347510:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cacc88eaa00 x1875527696873344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643142 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643142.347520:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643132/real 1788643132] req@ffff9cabc7454e00 x1875527696873088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643142 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643142.347531:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cabc7454e00 x1875527696873088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643142 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788643142.347548:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc3245000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788643142.347600:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788643142.347605:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696873344:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788643142.347611:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc3be4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788643142.350098:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643142.350103:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643142.350106:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643142.350108:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643142.350123:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643142.350126:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788643142.350128:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cacc3be4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788643142.350135:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 613 00000100:00080000:0.0:1788643142.350140:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788643142.350146:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9cacc3be4800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643142.350163:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc9998000 x1875527696880256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788643142.350173:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643142.350176:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788643142.350178:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cacc3245000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788643142.350181:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 613 00000100:00080000:0.0:1788643142.350183:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788643142.350192:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cacc3245000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643142.350204:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc999bb80 x1875527696880384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788643142.350241:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696880128:0@lo:400:kworker.0 00000100:00100000:0.0:1788643142.350338:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643142.350399:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788643142.350406:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696879744:0@lo:400:kworker.0 00000100:00100000:0.0:1788643142.350437:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643142.350464:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875527696880512:0@lo:400:kworker.0 00000100:00100000:0.0:1788643142.350491:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643142.350517:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696879872:0@lo:400:kworker.0 00000100:00100000:0.0:1788643142.350537:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643142.350555:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788643142.350560:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875527696880000:0@lo:400:kworker.0 00000100:00100000:0.0:1788643142.350579:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643142.350610:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696880128 00000100:00100000:0.0:1788643142.350617:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696880128 00000100:00100000:0.0:1788643142.350653:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696879872 00000100:00100000:0.0:1788643142.350656:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696879872 00000100:00100000:0.0:1788643142.350673:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788643142.350680:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696880128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643142.350728:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696880128:12345-0@lo:400:kworker.0 Request processed in 48us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643142.350735:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788643142.350752:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788643142.350758:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875527696879872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643142.350797:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875527696879872:12345-0@lo:400:kworker.0 Request processed in 40us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643142.350804:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788643142.350822:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696879744 00000100:00100000:0.0:1788643142.350826:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696879744 00000100:00100000:0.0:1788643142.350848:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788643142.350854:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+18:3644:x1875527696879744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643142.351474:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+18:3644:x1875527696879744:12345-0@lo:400:kworker.0 Request processed in 619us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643142.351483:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788643142.351513:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696880512 00000100:00100000:0.0:1788643142.351517:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696880512 00000100:00100000:0.0:1788643142.351588:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696880000 00000100:00100000:0.0:1788643142.351592:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696880000 00000100:00080000:1.0:1788643142.352160:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788643142.352166:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696873088:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788643142.352192:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696880256:0@lo:8:kworker.0 00000400:00000100:1.0:1788643142.352222:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527696880256 offset 0 length 520: 4 00000100:00100000:1.0:1788643142.352247:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696880384:0@lo:8:kworker.0 00000400:00000100:1.0:1788643142.352265:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527696880384 offset 0 length 520: 4 00000100:00100000:3.0:1788643142.353601:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788643142.353614:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875527696880512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643142.353670:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875527696880512:12345-0@lo:400:kworker.0 Request processed in 61us (3178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643142.353678:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788643142.353696:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788643142.353702:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875527696880000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643142.353729:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875527696880000:12345-0@lo:400:kworker.0 Request processed in 28us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643142.353745:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788643142.354065:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cacc999b100 x1875527696880000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643142.354078:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875527696880000:0@lo:400:kworker.0 00000100:00100000:0.0:1788643142.354091:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696879872:0@lo:400:kworker.0 00000100:00080000:0.0:1788643142.354150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643142.354154:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643142.354157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643142.354160:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788643142.355023:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696879744:0@lo:400:kworker.0 00010000:00080000:2.0:1788643142.355038:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cacc9998700 x1875527696880512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643142.355055:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875527696880512:0@lo:400:kworker.0 00000100:00100000:2.0:1788643142.355069:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696880128:0@lo:400:kworker.0 00010000:00010000:1.0:1788643142.795782:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788643143.116127:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788643143.371670:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696880640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788643143.371736:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643143.371792:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696880640 00000100:00100000:2.0:1788643143.371799:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696880640 00000100:00100000:2.0:1788643143.371844:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788643143.371853:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696880640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788643143.371894:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788643143.371938:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696880640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643143.371945:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788643143.371988:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696880640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788643143.381297:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696880768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788643143.381365:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643143.381593:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696880768 00000100:00100000:2.0:1788643143.381602:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696880768 00000100:00100000:2.0:1788643143.381666:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788643143.381675:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875527696880768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788643143.381721:0:23495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788643143.381766:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875527696880768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643143.381773:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788643143.381903:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696880768:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788643143.819556:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788643143.886948:0:23485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:0.0:1788643144.076322:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788643144.845631:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643145.870376:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643146.443698:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643131/real 1788643131] req@ffff9cabc7ece680 x1875527696871168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643146 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643146.443730:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cabc7ece680 x1875527696871168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643146 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643146.443741:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643131/real 1788643131] req@ffff9cabc7ecf480 x1875527696871296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643146 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643146.443752:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cabc7ecf480 x1875527696871296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643146 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788643146.443769:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788643146.443792:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788643146.443796:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696871168:0@lo:8:kworker.0 00000100:00080000:3.0:1788643146.443801:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc7914800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788643146.443806:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788643146.443809:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696871296:0@lo:8:kworker.0 00000100:00080000:0.0:1788643146.443993:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643146.443997:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788643146.444000:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788643146.444004:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:0.0:1788643146.444009:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788643146.444015:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cabc89e5000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643146.444035:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacf7f02a00 x1875527696881152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788643146.444048:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643146.444050:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788643146.444052:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cabc7914800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788643146.444054:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:0.0:1788643146.444057:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788643146.444061:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cabc7914800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643146.444072:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacf7f00e00 x1875527696881280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788643146.444097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643146.444101:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643146.444103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643146.444106:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788643146.444126:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696881536:0@lo:400:kworker.0 00000100:00100000:0.0:1788643146.444195:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643146.444267:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788643146.444274:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875527696881408:0@lo:400:kworker.0 00000100:00100000:0.0:1788643146.444301:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643146.444330:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696881408 00000100:00100000:0.0:1788643146.444338:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696881408 00000100:00100000:0.0:1788643146.444378:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788643146.444408:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875527696881408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643146.444450:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875527696881408:12345-0@lo:400:kworker.0 Request processed in 45us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643146.444458:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788643146.444491:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cacf7f02680 x1875527696881408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643146.444503:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875527696881408:0@lo:400:kworker.0 00000100:00100000:2.0:1788643146.444665:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696881536 00000100:00100000:2.0:1788643146.444678:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696881536 00000100:00100000:3.0:1788643146.444707:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696880896:0@lo:400:kworker.0 00000100:00100000:3.0:1788643146.444740:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643146.444765:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875527696881664:0@lo:400:kworker.0 00000100:00100000:3.0:1788643146.444791:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643146.444813:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788643146.444821:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788643146.444822:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696881024:0@lo:400:kworker.0 00000100:00100000:2.0:1788643146.444834:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696881536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643146.444875:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643146.444904:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696881536:12345-0@lo:400:kworker.0 Request processed in 74us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643146.444914:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788643146.444917:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696881664 00000100:00100000:2.0:1788643146.444928:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696881024 00000100:00100000:3.0:1788643146.444929:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696881664 00000100:00100000:2.0:1788643146.444933:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696881024 00000100:00100000:2.0:1788643146.444957:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788643146.444963:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696881024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643146.444968:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788643146.444978:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875527696881664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643146.445001:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696881024:12345-0@lo:400:kworker.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643146.445008:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788643146.445025:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875527696881664:12345-0@lo:400:kworker.0 Request processed in 48us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643146.445028:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696880896 00000100:00100000:2.0:1788643146.445033:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696880896 00000100:00100000:3.0:1788643146.445037:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788643146.445065:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788643146.445074:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+18:3644:x1875527696880896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643146.445077:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696881152:0@lo:8:kworker.0 00000400:00000100:3.0:1788643146.445112:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527696881152 offset 0 length 520: 4 00000100:00100000:2.0:1788643146.445114:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+18:3644:x1875527696880896:12345-0@lo:400:kworker.0 Request processed in 41us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643146.445124:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788643146.445133:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696881280:0@lo:8:kworker.0 00000400:00000100:3.0:1788643146.445268:0:3641:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527696881280 offset 0 length 520: 4 00000100:00100000:2.0:1788643146.448363:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696881536:0@lo:400:kworker.0 00000100:00100000:2.0:1788643146.448588:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696881024:0@lo:400:kworker.0 00000100:00100000:2.0:1788643146.448599:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696880896:0@lo:400:kworker.0 00010000:00080000:2.0:1788643146.448613:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cacf7f03800 x1875527696881664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643146.449320:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875527696881664:0@lo:400:kworker.0 00010000:00010000:0.0:1788643146.892090:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788643147.638083:0:24254:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788643147.638087:0:24254:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788643147.638089:0:24254:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788643147.638241:0:24254:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cacf7e56800 00000020:01000004:2.0:1788643147.638255:0:24254:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788643147.638267:0:24254:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788643147.638282:0:24254:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cabc7920000) 00000020:00000080:2.0:1788643147.638299:0:24254:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788643147.855298:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788643147.856069:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788643147.856588:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788643147.859077:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788643147.865272:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788643147.865898:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788643147.866428:0:24254:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1788643147.880172:0:24254:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788643147.880354:0:24254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788643147.880365:0:24254:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788643147.880374:0:24254:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x119ccc6e683c3e82 00000020:01000004:0.0:1788643147.880407:0:24254:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788643147.880540:0:24254:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788643147.880548:0:24254:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788643147.880554:0:24254:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788643147.880559:0:24254:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788643147.880568:0:24254:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cacf573cd40) 00000020:00000080:0.0:1788643147.880579:0:24254:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788643147.883371:0:24254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788643147.884969:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788643147.884976:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788643147.889221:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788643147.889234:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788643147.895707:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788643147.895721:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788643147.900520:0:24254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788643147.901537:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788643147.901545:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788643147.906747:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788643147.906763:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:1.0:1788643147.917623:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643147.944965:0:24254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788643147.945195:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788643147.945204:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788643147.947598:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788643147.947615:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788643147.949599:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788643147.949610:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788643147.965838:0:24254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788643147.966103:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788643147.966111:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788643147.976900:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788643147.976912:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788643148.053866:0:24254:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788643148.054093:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788643148.054102:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788643148.056495:0:24254:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788643148.056508:0:24254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788643148.060581:0:24254:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788643148.060621:0:24254:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788643148.060628:0:24254:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788643148.094892:0:24254:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788643148.094967:0:24254:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.118@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788643148.094972:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788643148.094974:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788643148.094976:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788643148.094977:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788643148.094979:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788643148.094980:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788643148.094982:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788643148.094983:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788643148.094985:0:24254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788643148.094990:0:24254:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788643148.094992:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788643148.094994:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788643148.094995:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788643148.094996:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788643148.094997:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788643148.094998:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788643148.094999:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788643148.095000:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788643148.095001:0:24254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788643148.095040:0:24254:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788643148.095066:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696881792:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788643148.095165:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.095226:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc4ac3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788643148.095546:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696881792 00000100:00100000:2.0:1788643148.095560:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696881792 00000100:00100000:2.0:1788643148.095620:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788643148.095630:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:24254:x1875527696881792:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788643148.095667:0:22745:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788643148.095670:0:22745:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788643148.095694:0:22745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788643148.098556:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:24254:x1875527696881792:12345-0@lo:253:mount.lustre.0 Request processed in 2919us (3383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643148.098575:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788643148.098627:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696881792:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788643148.098652:0:24254:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788643148.098655:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788643148.098657:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788643148.098658:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788643148.098659:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788643148.098660:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788643148.098661:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788643148.098663:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788643148.098665:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788643148.098667:0:24254:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788643148.098700:0:24254:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cacf7e56800 from lustre-OST0000 10000000:01000000:0.0:1788643148.098766:0:24254:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788643148.098770:0:24254:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788643148.098795:0:24254:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cacfdc88000 local copy 00010000:00010000:0.0:1788643148.098808:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643148.099062:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696881920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643148.099128:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.099187:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccba67240 going to sleep for 11 seconds 00000100:00100000:2.0:1788643148.099280:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696881920 00000100:00100000:2.0:1788643148.099289:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696881920 00000100:00100000:2.0:1788643148.099335:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788643148.099344:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+18:24254:x1875527696881920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643148.099494:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+18:24254:x1875527696881920:12345-0@lo:501:mount.lustre.0 Request processed in 150us (365us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788643148.099502:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788643148.099534:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696881920:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788643148.099553:0:24254:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788643148.099577:0:24254:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788643148.099586:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.099596:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643148.099643:0:24254:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cacf7e56800 10000000:01000000:0.0:1788643148.099649:0:24254:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788643148.099654:0:24254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788643148.099657:0:24254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788643148.099663:0:24254:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788643148.099666:0:24254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788643148.099695:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aaa00/0x119ccc6e683c3e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.099704:0:24254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aaa00/0x119ccc6e683c3e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.099715:0:24254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aaa00/0x119ccc6e683c3e90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643148.099730:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788643148.099764:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.099803:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccba67240 going to sleep for 11 seconds 00000100:00100000:2.0:1788643148.099843:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696882048 00000100:00100000:2.0:1788643148.099862:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696882048 00000100:00100000:2.0:1788643148.099894:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788643148.099900:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+18:24254:x1875527696882048:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643148.099910:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643148.099929:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cabc7494000/0x119ccc6e683c3e97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3e90 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.099952:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cabc7494000/0x119ccc6e683c3e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3e90 expref: 19 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.099963:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cabc7494000/0x119ccc6e683c3e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3e90 expref: 19 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.099971:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7494000, rc 0) 00000100:00100000:2.0:1788643148.100017:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+19:24254:x1875527696882048:12345-0@lo:101:mount.lustre.0 Request processed in 117us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643148.100023:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788643148.100071:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788643148.100091:0:24254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aaa00/0x119ccc6e683c3e90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e97 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.100101:0:24254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aaa00/0x119ccc6e683c3e90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3e97 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788643148.102031:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788643148.104216:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788643148.112597:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788643148.113050:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788643148.113069:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788643148.113081:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788643148.113094:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788643148.113108:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788643148.113123:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788643148.113158:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788643148.113174:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1788643148.113187:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1788643148.113201:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1788643148.113215:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1788643148.113252:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1788643148.113258:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1788643148.113427:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643148.113818:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.113893:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccba67cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788643148.115292:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696882176 00000100:00100000:2.0:1788643148.115307:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696882176 00000100:00100000:2.0:1788643148.115375:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788643148.115420:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+19:24254:x1875527696882176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643148.115609:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+19:24254:x1875527696882176:12345-0@lo:501:mount.lustre.0 Request processed in 226us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643148.115617:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788643148.115734:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643148.115795:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788643148.122059:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.122109:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccba67cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788643148.122339:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696882304 00000100:00100000:2.0:1788643148.122347:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696882304 00000100:00100000:0.0:1788643148.122537:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788643148.122548:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+19:24254:x1875527696882304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788643148.123786:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+19:24254:x1875527696882304:12345-0@lo:503:mount.lustre.0 Request processed in 1235us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643148.123798:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788643148.123841:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882304:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788643148.124282:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788643148.124366:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882432:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643148.124580:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.124611:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacfcf7cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788643148.124827:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696882432 00000100:00100000:2.0:1788643148.124833:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696882432 00000100:00100000:2.0:1788643148.124888:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788643148.124897:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+19:24254:x1875527696882432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788643148.126341:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+19:24254:x1875527696882432:12345-0@lo:502:mount.lustre.0 Request processed in 1439us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643148.126354:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788643148.126459:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882432:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788643148.126668:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788643148.126758:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788643148.126771:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788643148.126783:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788643148.126794:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788643148.126804:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788643148.126815:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788643148.126827:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788643148.126838:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788643148.126862:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788643148.126877:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788643148.126888:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788643148.126916:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882560:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643148.126959:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.126996:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccba67480 going to sleep for 11 seconds 00000100:00100000:1.0:1788643148.127107:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696882560 00000100:00100000:1.0:1788643148.127113:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696882560 00000100:00100000:1.0:1788643148.127231:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788643148.127240:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+19:24254:x1875527696882560:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788643148.127343:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+19:24254:x1875527696882560:12345-0@lo:502:mount.lustre.0 Request processed in 105us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643148.127351:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788643148.127778:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788643148.127840:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1788643148.127861:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788643148.133551:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788643148.133561:0:24271:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788643148.133567:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.133569:0:24271:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788643148.133578:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788643148.133592:0:24271:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cacf573b380) 00000020:00000080:0.0:1788643148.133615:0:24271:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788643148.133622:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788643148.133765:0:24271:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cacf7e56800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788643148.133773:0:24271:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788643148.133781:0:24271:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x119ccc6e683c3ea5 00010000:00010000:0.0:1788643148.138490:0:24271:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788643148.139000:0:24271:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788643148.141028:0:24271:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788643148.144008:0:24271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788643148.144021:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643148.144031:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.144033:0:24271:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788643148.144037:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788643148.144040:0:24271:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788643148.144042:0:24271:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788643148.144043:0:24271:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788643148.144045:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788643148.144047:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.144048:0:24271:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788643148.144051:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643148.144053:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.144055:0:24271:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788643148.144058:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788643148.144059:0:24271:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788643148.144062:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643148.144064:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.144065:0:24271:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788643148.144067:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643148.144070:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.144071:0:24271:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788643148.144074:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788643148.144102:0:24271:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643148.144104:0:24271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.144105:0:24271:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788643148.144108:0:24271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788643148.144329:0:24254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788643148.144359:0:24254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788643148.144403:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aaa00/0x119ccc6e683c3e90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e97 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.144414:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aaa00/0x119ccc6e683c3e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3e97 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643148.144423:0:24254:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cacf7e56800 from 1 10000000:01000000:2.0:1788643148.144432:0:24254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788643148.144463:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.144471:0:24254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.144482:0:24254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643148.144504:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788643148.144565:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643148.144598:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6fc63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788643148.144620:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696882688 00000100:00100000:2.0:1788643148.144625:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696882688 00000100:00100000:2.0:1788643148.144664:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788643148.144672:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+19:24254:x1875527696882688:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643148.144766:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643148.144780:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cabc7495c00/0x119ccc6e683c3eb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3eac expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.144803:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cabc7495c00/0x119ccc6e683c3eb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3eac expref: 20 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.144813:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cabc7495c00/0x119ccc6e683c3eb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3eac expref: 20 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.144823:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7495c00, rc 0) 00000100:00100000:2.0:1788643148.144872:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+20:24254:x1875527696882688:12345-0@lo:101:mount.lustre.0 Request processed in 200us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643148.144888:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788643148.144930:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643148.144943:0:24254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.144951:0:24254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788643148.157141:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788643148.157480:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788643148.157665:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788643148.157692:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788643148.158325:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788643148.158348:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788643148.158363:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788643148.158378:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788643148.158419:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788643148.158433:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788643148.158455:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788643148.158466:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788643148.158477:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788643148.158493:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788643148.158499:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788643148.158579:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643148.158642:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.158692:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf61796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788643148.158755:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696882816 00000100:00100000:2.0:1788643148.158763:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696882816 00000100:00100000:2.0:1788643148.158812:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788643148.158823:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+20:24254:x1875527696882816:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643148.158995:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+20:24254:x1875527696882816:12345-0@lo:501:mount.lustre.0 Request processed in 174us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643148.159003:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788643148.161568:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643148.161630:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882944:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788643148.164756:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.164811:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf61796c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643148.165250:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696882944 00000100:00100000:1.0:1788643148.165260:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696882944 00000100:00100000:1.0:1788643148.165307:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788643148.165317:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+20:24254:x1875527696882944:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788643148.165473:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+20:24254:x1875527696882944:12345-0@lo:503:mount.lustre.0 Request processed in 156us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643148.165480:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788643148.170553:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696882944:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788643148.171212:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788643148.171328:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788643148.171474:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643148.171533:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc7d95cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788643148.172588:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696883072 00000100:00100000:0.0:1788643148.172602:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696883072 00000100:00100000:0.0:1788643148.172653:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788643148.172662:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+20:24254:x1875527696883072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643148.172823:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+20:24254:x1875527696883072:12345-0@lo:502:mount.lustre.0 Request processed in 162us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643148.172831:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788643148.173075:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788643148.174217:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788643148.174253:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788643148.174268:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788643148.174282:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788643148.174296:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788643148.174309:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788643148.174325:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788643148.174336:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788643148.174349:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788643148.174362:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788643148.174375:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788643148.174454:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883200:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788643148.174510:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643148.174545:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6fc6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788643148.174674:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696883200 00000100:00100000:0.0:1788643148.174681:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696883200 00000100:00100000:0.0:1788643148.174725:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788643148.174734:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+20:24254:x1875527696883200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643148.174825:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+20:24254:x1875527696883200:12345-0@lo:502:mount.lustre.0 Request processed in 92us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643148.174832:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788643148.175021:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883200:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788643148.175060:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788643148.175067:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788643148.177937:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643148.177960:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.177963:0:24275:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788643148.177972:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cacf7e56800 00000020:00000080:0.0:1788643148.177975:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788643148.177983:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643148.177986:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.177987:0:24275:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788643148.177989:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643148.177991:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.177992:0:24275:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788643148.177995:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cacf7e56800 00000020:00000080:0.0:1788643148.177997:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788643148.178081:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643148.178084:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.178086:0:24275:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788643148.178089:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643148.178091:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.178092:0:24275:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788643148.178095:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cacf7e56800 00000020:00000080:0.0:1788643148.178098:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788643148.181959:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643148.181969:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.181971:0:24275:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788643148.181976:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643148.181980:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.181981:0:24275:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788643148.181985:0:24275:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cacf7e56800 00000020:00000080:0.0:1788643148.181987:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788643148.182037:0:24275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643148.182040:0:24275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643148.182041:0:24275:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788643148.182044:0:24275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788643148.182106:0:24254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788643148.182131:0:24254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788643148.182149:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.182160:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643148.182215:0:24254:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788643148.182217:0:24254:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cacf7e56800 10000000:01000000:0.0:1788643148.182220:0:24254:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cacf7e56800 10000000:01000000:0.0:1788643148.182223:0:24254:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788643148.182228:0:24254:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cacf7e56800 from 1 10000000:01000000:0.0:1788643148.182230:0:24254:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788643148.182261:0:24254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa200/0x119ccc6e683c3eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.182268:0:24254:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa200/0x119ccc6e683c3eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.182278:0:24254:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa200/0x119ccc6e683c3eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643148.182298:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788643148.182353:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.182400:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3195240 going to sleep for 11 seconds 00000100:00100000:0.0:1788643148.182417:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696883328 00000100:00100000:0.0:1788643148.182423:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696883328 00000100:00100000:0.0:1788643148.182455:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788643148.182462:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+20:24254:x1875527696883328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788643148.182473:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643148.182483:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacfe7aae00/0x119ccc6e683c3ec1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3eba expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.182510:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacfe7aae00/0x119ccc6e683c3ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3eba expref: 21 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.182519:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacfe7aae00/0x119ccc6e683c3ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3eba expref: 21 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.182527:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacfe7aae00, rc 0) 00000100:00100000:0.0:1788643148.182559:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696883328:12345-0@lo:101:mount.lustre.0 Request processed in 98us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643148.182566:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788643148.182605:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788643148.182617:0:24254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa200/0x119ccc6e683c3eba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3ec1 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.182625:0:24254:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa200/0x119ccc6e683c3eba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3ec1 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788643148.223773:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1788643148.224121:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788643148.224415:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788643148.224450:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788643148.224467:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788643148.224484:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788643148.224502:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788643148.224536:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788643148.224576:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788643148.224598:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788643148.224617:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788643148.224631:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788643148.224645:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788643148.224662:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788643148.224681:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788643148.224700:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788643148.224720:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788643148.224743:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788643148.224768:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788643148.224804:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788643148.224829:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788643148.224861:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788643148.224880:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788643148.224897:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788643148.224915:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788643148.224931:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788643148.224949:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1788643148.224967:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1788643148.224983:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1788643148.224999:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1788643148.225016:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1788643148.225031:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1788643148.225048:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1788643148.225068:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1788643148.225085:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1788643148.225120:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1788643148.225138:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1788643148.225156:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1788643148.225176:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1788643148.225194:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1788643148.225226:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1788643148.225245:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1788643148.225263:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1788643148.225282:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1788643148.225304:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1788643148.225327:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1788643148.225347:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1788643148.225363:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1788643148.225420:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1788643148.225445:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1788643148.225625:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1788643148.225654:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1788643148.225679:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1788643148.225685:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1788643148.225775:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788643148.225837:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643148.225892:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacfcf7cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788643148.226162:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696883456 00000100:00100000:0.0:1788643148.226170:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696883456 00000100:00100000:0.0:1788643148.226220:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788643148.226229:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696883456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643148.226352:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696883456:12345-0@lo:501:mount.lustre.0 Request processed in 124us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643148.226360:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788643148.231070:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788643148.231125:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788643148.231198:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.231235:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696883584 00000100:00100000:1.0:1788643148.231240:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacfcf7cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788643148.231243:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696883584 00000100:00100000:0.0:1788643148.231302:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788643148.231311:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696883584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788643148.231447:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696883584:12345-0@lo:503:mount.lustre.0 Request processed in 137us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643148.231455:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788643148.231520:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883584:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788643148.232308:0:24254:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788643148.232411:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788643148.232459:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643148.232490:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacfcf7cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788643148.232887:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696883712 00000100:00100000:3.0:1788643148.232895:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696883712 00000100:00100000:3.0:1788643148.233097:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788643148.233108:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696883712:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788643148.233208:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696883712:12345-0@lo:502:mount.lustre.0 Request processed in 103us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643148.233216:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788643148.233309:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788643148.233491:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788643148.233516:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788643148.233528:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788643148.233540:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788643148.233553:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788643148.233582:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788643148.233596:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788643148.233610:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788643148.233623:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788643148.233635:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788643148.233663:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788643148.233682:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788643148.233696:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788643148.233713:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788643148.233734:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788643148.233753:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788643148.233772:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788643148.233790:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788643148.233810:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788643148.233826:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788643148.233840:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788643148.233873:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788643148.233887:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788643148.233903:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788643148.233919:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788643148.233935:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788643148.233970:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788643148.233988:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788643148.234005:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788643148.234019:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788643148.234038:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788643148.234053:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788643148.234078:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788643148.234098:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788643148.234117:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788643148.234136:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788643148.234151:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788643148.234169:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788643148.234191:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788643148.234215:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788643148.234235:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788643148.234252:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788643148.234283:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788643148.234300:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788643148.234317:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788643148.234333:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788643148.234350:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788643148.234366:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788643148.234442:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788643148.234497:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643148.234536:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacfcf7cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788643148.235252:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696883840 00000100:00100000:0.0:1788643148.235260:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696883840 00000100:00100000:0.0:1788643148.235310:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788643148.235319:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696883840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643148.235596:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696883840:12345-0@lo:502:mount.lustre.0 Request processed in 278us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643148.235604:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788643148.235669:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788643148.235980:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788643148.236010:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788643148.236043:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788643148.236085:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643148.236117:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc48a0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788643148.236171:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696883968 00000100:00100000:0.0:1788643148.236177:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696883968 00000100:00100000:0.0:1788643148.236208:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788643148.236216:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696883968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643148.236332:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696883968:12345-0@lo:502:mount.lustre.0 Request processed in 115us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643148.236339:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788643148.236369:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696883968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788643148.236810:0:24254:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788643148.236824:0:24254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788643148.240592:0:24281:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788643148.240610:0:24281:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cabc7a3cd40) 00000020:00000080:0.0:1788643148.240633:0:24281:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788643148.240724:0:24281:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cacf7e56800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788643148.240729:0:24281:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cacf7e56800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788643148.240732:0:24281:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cacf7e56800 3 00010000:00080000:0.0:1788643148.240778:0:24281:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cacc8c42800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788643148.242565:0:24281:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788643148.242758:0:24281:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788643148.242798:0:24281:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788643148.242810:0:24281:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x119ccc6e683c3ecf 00000100:00080000:0.0:1788643148.242819:0:24281:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788643148.242825:0:24281:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cacc8c42800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643148.242869:0:24281:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacf7f01500 x1875527696884096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788643148.242910:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875527696884096:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788643148.242975:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788643148.243037:0:24281:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788643148.243078:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643148.243082:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643148.243085:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643148.243088:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643148.243127:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643148.243130:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643148.243133:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643148.243135:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788643148.243169:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696884224:0@lo:400:kworker.0 00000100:00100000:0.0:1788643148.243203:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.243230:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788643148.243238:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875527696884608:0@lo:400:kworker.0 00000100:00100000:0.0:1788643148.243498:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.243532:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875527696884352:0@lo:400:kworker.0 00000100:00100000:0.0:1788643148.243560:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.243682:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788643148.243689:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696884480:0@lo:400:kworker.0 00000100:00100000:0.0:1788643148.243714:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.243749:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696884096 00000100:00100000:0.0:1788643148.243756:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696884096 00000100:00100000:0.0:1788643148.243778:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696884608 00000100:00100000:0.0:1788643148.243781:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696884608 00000100:00100000:0.0:1788643148.243805:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696884352 00000100:00100000:0.0:1788643148.243808:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696884352 00000100:00100000:0.0:1788643148.243902:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788643148.243914:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875527696884608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643148.243974:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875527696884608:12345-0@lo:400:kworker.0 Request processed in 63us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643148.245019:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788643148.245048:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788643148.245072:0:22753:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788643148.245080:0:22753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788643148.245102:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788643148.245114:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788643148.245121:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875527696884096:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788643148.245147:0:22752:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:0.0:1788643148.245180:0:22752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x119ccc6e683c3ed6 00000004:00100000:0.0:1788643148.245197:0:22752:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788643148.245226:0:22752:0:(import.c:65:import_set_state_nolock()) ffff9cabc7db1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788643148.245279:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696884224 00000100:00100000:2.0:1788643148.245286:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696884224 00000100:00100000:0.0:1788643148.245287:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875527696884096:12345-0@lo:38:llog_process_th.0 Request processed in 164us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643148.245303:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788643148.245321:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696884480 00000100:00100000:2.0:1788643148.245325:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696884480 00000100:00100000:0.0:1788643148.245337:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788643148.245367:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875527696884352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643148.245425:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875527696884352:12345-0@lo:400:kworker.0 Request processed in 63us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643148.245432:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788643148.245502:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696884224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643148.245553:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696884224:12345-0@lo:400:kworker.0 Request processed in 208us (2349us total) trans 0 rc 0/0 00010000:00080000:1.0:1788643148.247171:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cacf7f01500 x1875527696884096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788643158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643148.247184:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788643148.247203:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788643148.247211:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788643148.247217:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788643148.247219:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc8c42800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788643148.247226:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875527696884096:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788643148.247267:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cacf7f03800 x1875527696884608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643148.247294:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875527696884608:0@lo:400:kworker.0 00000100:00100000:1.0:1788643148.247312:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696884224:0@lo:400:kworker.0 00000100:00100000:0.0:1788643148.254663:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788643148.254700:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788643148.254713:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696884480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643148.254802:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696884480:12345-0@lo:400:kworker.0 Request processed in 94us (11086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643148.254809:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788643148.254865:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696884480:0@lo:400:kworker.0 00010000:00080000:0.0:1788643148.254883:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cacf7f00a80 x1875527696884352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643148.254893:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875527696884352:0@lo:400:kworker.0 00000020:01000004:0.0:1788643148.255537:0:24281:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788643148.255551:0:24281:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9cabc7a399c0) 00000020:00000080:0.0:1788643148.255575:0:24281:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788643148.255679:0:24281:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cacf7e56800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788643148.255683:0:24281:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cacf7e56800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788643148.255686:0:24281:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cacf7e56800 3 00010000:00080000:0.0:1788643148.255715:0:24281:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cabc76c0800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.118@tcp at head 00010000:00010000:0.0:1788643148.257443:0:24281:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788643148.257646:0:24281:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788643148.257692:0:24281:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788643148.257713:0:24281:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x119ccc6e683c3ee4 00000100:00080000:0.0:1788643148.257723:0:24281:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788643148.257728:0:24281:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9cabc76c0800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643148.257762:0:24281:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc9998700 x1875527696884736/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788643148.257793:0:24281:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788643148.257815:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643148.257819:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643148.257822:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643148.257825:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643148.257829:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643148.257832:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643148.257835:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643148.257838:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788643148.258247:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1875527696884736:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788643148.258310:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643148.258410:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696884736 00000100:00100000:1.0:1788643148.258417:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696884736 00000100:00100000:1.0:1788643148.258477:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788643148.258484:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875527696884736:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788643148.258509:0:22754:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:1.0:1788643148.258538:0:22754:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x119ccc6e683c3eeb 00000040:00080000:0.0:1788643148.259754:0:24281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1788643148.260052:0:24254:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788643148.260081:0:24254:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788643148.260097:0:24254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa200/0x119ccc6e683c3eba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3ec1 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.260108:0:24254:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aa200/0x119ccc6e683c3eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3ec1 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788643148.260152:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788643148.260154:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788643148.260160:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788643148.260161:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788643148.260162:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788643148.260163:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788643148.260164:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788643148.260166:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788643148.260167:0:24254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788643148.260171:0:24254:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788643148.260173:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788643148.260174:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788643148.260175:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788643148.260176:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788643148.260177:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788643148.260178:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788643148.260179:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788643148.260180:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788643148.260181:0:24254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788643148.260202:0:24254:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788643148.260217:0:24254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696884864:0@lo:253:mount.lustre.0 00000004:00100000:1.0:1788643148.260457:0:22754:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788643148.260493:0:22754:0:(import.c:65:import_set_state_nolock()) ffff9cacd8150800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788643148.260554:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875527696884736:12345-0@lo:38:llog_process_th.0 Request processed in 2069us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643148.260581:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788643148.261121:0:24254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.261173:0:24254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc7619e40 going to sleep for 11 seconds 00010000:00080000:3.0:1788643148.261234:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cacc9998700 x1875527696884736/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788643158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643148.261245:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788643148.261253:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788643148.261261:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788643148.261266:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788643148.261268:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc76c0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788643148.261274:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1875527696884736:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788643148.268985:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696884864 00000100:00100000:1.0:1788643148.268999:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696884864 00000100:00100000:1.0:1788643148.269055:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788643148.269064:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696884864:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788643148.269095:0:22746:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788643148.269109:0:22746:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788643148.274172:0:22746:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788643148.275296:0:22746:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788643148.275731:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+21:24254:x1875527696884864:12345-0@lo:253:mount.lustre.0 Request processed in 6657us (14602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643148.275751:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 20000000:01000000:0.0:1788643148.276335:0:22768:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788643148.276341:0:22768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788643148.276362:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.276402:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cad02174c00/0x119ccc6e683c3e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3e35 expref: 20 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.276410:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cad02174600/0x119ccc6e683c3e4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3e43 expref: 20 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.276418:0:22768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.276454:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cad02174600/0x119ccc6e683c3e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3e43 expref: 20 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.276477:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cad02174600/0x119ccc6e683c3e4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3e43 expref: 20 pid: 22745 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643148.276495:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696884992:0@lo:104: 00000100:00100000:0.0:1788643148.276573:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788643148.276634:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cad02174c00/0x119ccc6e683c3e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3e35 expref: 20 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643148.276644:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cad02174c00/0x119ccc6e683c3e3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3e35 expref: 20 pid: 22745 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643148.276652:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696885120:0@lo:104: 00000100:00100000:0.0:1788643148.276676:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.276703:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc7619a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788643148.276741:0:24254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:24254:1875527696884864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788643148.276747:0:22736:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 10000000:01000000:0.0:1788643148.276753:0:24254:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788643148.276758:0:24254:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788643148.276760:0:24254:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788643148.276761:0:24254:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788643148.276762:0:24254:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788643148.276764:0:24254:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788643148.276765:0:24254:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788643148.276766:0:24254:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788643148.276768:0:24254:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:2.0:1788643148.276769:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696884992 00000100:00100000:2.0:1788643148.276776:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696884992 00000020:01000004:0.0:1788643148.276888:0:24254:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788643148.276902:0:24254:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788643148.277061:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696885120 00000100:00100000:2.0:1788643148.277066:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696885120 00000100:00100000:2.0:1788643148.277089:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788643148.277100:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+4:22768:x1875527696884992:12345-0@lo:104: 00010000:00010000:2.0:1788643148.277113:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277183:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788643148.277190:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+4:22768:x1875527696884992:12345-0@lo:104: Request processed in 94us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643148.277203:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788643148.277226:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788643148.277233:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacdfd60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+3:22768:x1875527696885120:12345-0@lo:104: 00010000:00010000:2.0:1788643148.277241:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643148.277326:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696884992:0@lo:104: 00000100:00100000:1.0:1788643148.277361:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696885120:0@lo:104: 00010000:00010000:1.0:1788643148.277422:0:22768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277477:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788643148.277485:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacdfd60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+3:22768:x1875527696885120:12345-0@lo:104: Request processed in 252us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643148.277492:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788643148.277531:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788643148.277537:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277546:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7aba00 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:2.0:1788643148.277550:0:22741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277678:0:22741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788643148.277688:0:22741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643148.277693:0:22741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788643148.277730:0:22741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277737:0:22741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788643148.277764:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277771:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacfe7aba00/0x119ccc6e683c3e43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e4a expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277782:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643148.277785:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277791:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cad02174800 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:2.0:1788643148.277794:0:22741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277874:0:22741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788643148.277881:0:22741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643148.277887:0:22741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788643148.277901:0:22741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277906:0:22741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788643148.277921:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277927:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cad02174800/0x119ccc6e683c3e35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e3c expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643148.277950:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643148.277951:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643148.277953:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643148.277962:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788643148.277975:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da540a41-a984-4ac4-89dc-6d833e36a776:3643:1875527696885376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788643148.278008:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788643148.278107:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643148.278110:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788643148.278121:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696885248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788643148.278149:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643148.278256:0:23507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696885376 00000100:00100000:1.0:1788643148.278262:0:23507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696885376 00010000:00010000:1.0:1788643148.278292:0:23507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cad02174c00/0x119ccc6e683c3e3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3e35 expref: 21 pid: 22745 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643148.278312:0:23507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696885248 00000100:00100000:1.0:1788643148.278314:0:23507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696885248 00010000:00010000:1.0:1788643148.278323:0:23507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cad02174600/0x119ccc6e683c3e4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3e43 expref: 22 pid: 22745 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643148.278339:0:23507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788643148.278345:0:23507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7456300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da540a41-a984-4ac4-89dc-6d833e36a776+22:3643:x1875527696885376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788643148.278356:0:23507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643148.278360:0:23507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cad02174c00/0x119ccc6e683c3e3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3e35 expref: 22 pid: 22745 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278369:0:23507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cad02174c00/0x119ccc6e683c3e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3e35 expref: 22 pid: 22745 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278412:0:23507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cad02174c00/0x119ccc6e683c3e3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3e35 expref: 22 pid: 22745 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278424:0:23507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643148.278453:0:23507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7456300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da540a41-a984-4ac4-89dc-6d833e36a776+21:3643:x1875527696885376:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643148.278460:0:23507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788643148.278481:0:23507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788643148.278486:0:23507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc8dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da540a41-a984-4ac4-89dc-6d833e36a776+20:3644:x1875527696885248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788643148.278493:0:23507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643148.278498:0:23507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cad02174600/0x119ccc6e683c3e4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3e43 expref: 20 pid: 22745 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278507:0:23507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cad02174600/0x119ccc6e683c3e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3e43 expref: 20 pid: 22745 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278516:0:23507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cad02174600/0x119ccc6e683c3e4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3e43 expref: 20 pid: 22745 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278527:0:23507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278535:0:23507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788643148.278548:0:23507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006594089s 00010000:00010000:1.0:1788643148.278551:0:23507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278559:0:23507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278565:0:23507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278571:0:23507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278576:0:23507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7aa800 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643148.278584:0:23507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278592:0:23507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278604:0:23507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278618:0:23507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643148.278642:0:23507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc8dd7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da540a41-a984-4ac4-89dc-6d833e36a776+19:3644:x1875527696885248:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643148.278648:0:23507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788643148.278694:0:22768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278702:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643148.278709:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacfe7aa800/0x119ccc6e683c3ef2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643148.278788:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da540a41-a984-4ac4-89dc-6d833e36a776:3643:1875527696885376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788643148.278888:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696885248:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788643148.284167:0:24254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788643148.292004:0:24254:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788643148.292014:0:24254:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788643148.292052:0:24254:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788643148.292109:0:24254:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788643148.292128:0:24254:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788643148.292151:0:24254:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788643148.293070:0:24254:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788643148.293265:0:24254:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788643148.494681:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788643148.494709:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696885504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788643148.494791:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643148.494880:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696885504 00000100:00100000:0.0:1788643148.494889:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696885504 00000100:00100000:0.0:1788643148.494954:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788643148.494964:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696885504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788643148.495006:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788643148.495060:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696885504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643148.495067:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788643148.495121:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696885504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788643148.499607:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696885632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788643148.499697:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643148.499767:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696885632 00000100:00100000:3.0:1788643148.499775:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696885632 00000100:00100000:3.0:1788643148.499855:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788643148.499866:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696885632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788643148.499908:0:22757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788643148.500454:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696885632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 589us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643148.500476:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788643148.500535:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696885632:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788643148.939810:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788643149.323457:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788643149.323468:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cabc783a000 from 13 10000000:01000000:1.0:1788643149.323474:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788643149.324585:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643149.324601:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643149.324629:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643149.324660:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696885760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788643149.324748:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643149.324797:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc48a0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788643149.326034:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696885760 00000100:00100000:3.0:1788643149.326047:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696885760 00000100:00100000:3.0:1788643149.326109:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788643149.326121:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+19:22749:x1875527696885760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643149.326139:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643149.326162:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacf6d3c800/0x119ccc6e683c3f00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3ef9 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643149.326205:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacf6d3c800/0x119ccc6e683c3f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3ef9 expref: 20 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643149.326218:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacf6d3c800/0x119ccc6e683c3f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3ef9 expref: 20 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643149.326230:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacf6d3c800, rc 0) 00000100:00100000:3.0:1788643149.326304:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+20:22749:x1875527696885760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643149.326311:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788643149.326539:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696885760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788643149.326558:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643149.326569:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643149.326639:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696885888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788643149.326679:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643149.326712:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc48a0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788643149.326927:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696885888 00000100:00100000:3.0:1788643149.326933:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696885888 00000100:00100000:3.0:1788643149.326963:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788643149.326969:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+20:22749:x1875527696885888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788643149.326985:0:22746:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788643149.327003:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788643149.327011:0:22746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788643149.327098:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+20:22749:x1875527696885888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643149.327105:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788643149.328229:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696885888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788643149.328312:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788643149.328322:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643149.328334:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643149.328346:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788643149.328348:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cabc94a4800 from 13 10000000:01000000:3.0:1788643149.328351:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788643149.328402:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643149.328411:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643149.328421:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643149.328452:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696886016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788643149.328506:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643149.328537:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788643149.328557:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696886016 00000100:00100000:3.0:1788643149.328562:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696886016 00000100:00100000:3.0:1788643149.328603:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788643149.328610:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+20:22749:x1875527696886016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643149.328622:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643149.328638:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacf6d3d800/0x119ccc6e683c3f0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3f07 expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643149.328660:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacf6d3d800/0x119ccc6e683c3f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3f07 expref: 21 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643149.328671:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacf6d3d800/0x119ccc6e683c3f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3f07 expref: 21 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643149.328680:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacf6d3d800, rc 0) 00000100:00100000:3.0:1788643149.328709:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+21:22749:x1875527696886016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643149.328715:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788643149.328748:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696886016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643149.328757:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643149.328766:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643149.328800:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696886144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788643149.329505:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643149.329552:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc3bfbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788643149.329752:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696886144 00000100:00100000:2.0:1788643149.329759:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696886144 00000100:00100000:2.0:1788643149.329798:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788643149.329806:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:22749:x1875527696886144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788643149.330064:0:22744:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788643149.330089:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788643149.330093:0:22744:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788643149.333335:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:22749:x1875527696886144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 3516us (3820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643149.333356:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788643149.333875:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696886144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788643149.333973:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788643149.333986:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643149.333999:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1788643149.696931:0:24337:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788643149.697460:0:24337:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788643149.992926:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643150.995495:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643152.018347:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643153.035603:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788643153.356083:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1788643153.615276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643153.615282:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643153.615284:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643153.615287:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643153.615298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643153.615301:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643153.615303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643153.615306:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788643153.615343:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696886272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788643153.616544:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643153.616601:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696886784:0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.616626:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643153.616648:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696887296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788643153.616665:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643153.616698:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788643153.616704:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875527696886656:0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.616729:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643153.616746:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875527696887168:0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.616769:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643153.616812:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696886400:0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.616852:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643153.616876:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875527696886912:0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.616908:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643153.616928:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788643153.616934:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696886528:0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.616953:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643153.616965:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875527696887040:0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.616985:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643153.617018:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696886272 00000100:00100000:0.0:1788643153.617025:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696886272 00000100:00100000:0.0:1788643153.617059:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696886784 00000100:00100000:0.0:1788643153.617062:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696886784 00000100:00100000:0.0:1788643153.617072:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696887296 00000100:00100000:0.0:1788643153.617074:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696887296 00000100:00100000:0.0:1788643153.617083:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696886528 00000100:00100000:0.0:1788643153.617085:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696886528 00000100:00100000:0.0:1788643153.617097:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788643153.617104:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875527696886272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788643153.618897:0:22757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788643153.618976:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875527696886272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1869us (2433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643153.618986:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788643153.619014:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788643153.619023:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696886784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.619056:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696886784:12345-0@lo:400:kworker.0 Request processed in 36us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643153.619062:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788643153.619071:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788643153.619076:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875527696887296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788643153.619104:0:22757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788643153.619755:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875527696887296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643153.619763:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788643153.619779:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788643153.619787:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696886528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.620562:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696886528:12345-0@lo:400:kworker.0 Request processed in 775us (3606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643153.620569:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788643153.620604:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696886656 00000100:00100000:0.0:1788643153.620611:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696886656 00000100:00100000:0.0:1788643153.620635:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696887168 00000100:00100000:0.0:1788643153.620638:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696887168 00000100:00100000:0.0:1788643153.620663:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696886912 00000100:00100000:0.0:1788643153.620665:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696886912 00000100:00100000:0.0:1788643153.620676:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696887040 00000100:00100000:1.0:1788643153.620891:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696886528:0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.621413:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696887040 00000100:00100000:0.0:1788643153.621506:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788643153.621514:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875527696886656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.621558:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875527696886656:12345-0@lo:400:kworker.0 Request processed in 46us (4829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643153.621565:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788643153.621577:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788643153.621583:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875527696887168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.621608:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875527696887168:12345-0@lo:400:kworker.0 Request processed in 27us (4839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643153.621614:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788643153.621633:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788643153.621638:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875527696886912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.621676:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875527696886912:12345-0@lo:400:kworker.0 Request processed in 38us (4766us total) trans 0 rc 0/0 00010000:00080000:1.0:1788643153.621919:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacc999b480 x1875527696886912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643153.621932:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875527696886912:0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.622068:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788643153.622083:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788643153.622091:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875527696887040:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788643153.622534:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacefa23100 x1875527696887040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643153.622545:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875527696887040:0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.622608:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875527696887040:12345-0@lo:400:kworker.0 Request processed in 517us (5620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643153.622615:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788643153.622640:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696886400 00000100:00100000:0.0:1788643153.622646:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696886400 00000100:00100000:1.0:1788643153.623912:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788643153.623931:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:3642:x1875527696886400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643153.623985:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:3642:x1875527696886400:12345-0@lo:400:kworker.0 Request processed in 58us (7132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643153.623991:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788643153.624124:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788643153.624503:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788643153.624536:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacc999b100 x1875527696886656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643153.624549:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875527696886656:0@lo:400:kworker.0 00010000:00080000:0.0:1788643153.624560:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacefa21c00 x1875527696887168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643153.624568:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875527696887168:0@lo:400:kworker.0 00000100:00100000:0.0:1788643153.624583:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696887296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788643153.624594:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696886272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788643153.624602:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696886784:0@lo:400:kworker.0 00000100:00100000:1.0:1788643153.625286:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696886400:0@lo:400:kworker.0 00010000:00010000:0.0:1788643154.079607:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788643154.316031:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788643155.085001:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788643156.025584:0:24630:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788643156.111547:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788643157.066007:0:24682:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788643157.066350:0:24682:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788643157.132533:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643157.520528:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643142/real 1788643142] req@ffff9cacc9998000 x1875527696880256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643157 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643157.520555:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cacc9998000 x1875527696880256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643157 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643157.520565:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643142/real 1788643142] req@ffff9cacc999bb80 x1875527696880384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643157 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643157.520576:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cacc999bb80 x1875527696880384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643157 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788643157.520596:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc3be4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788643157.520607:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788643157.520611:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696880256:0@lo:8:kworker.0 00000100:00080000:1.0:1788643157.520616:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc3245000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788643157.520621:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788643157.520624:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696880384:0@lo:8:kworker.0 00000100:00080000:0.0:1788643157.521566:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643157.521570:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643157.521573:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643157.521576:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788643157.521595:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643157.521598:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788643157.521601:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cacc3be4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788643157.521607:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 623 00000100:00080000:0.0:1788643157.521612:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788643157.521618:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9cacc3be4800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643157.521637:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacefa20a80 x1875527696887936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788643157.521651:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788643157.521654:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788643157.521655:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cacc3245000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788643157.521659:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 623 00000100:00080000:0.0:1788643157.521661:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788643157.521664:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cacc3245000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:0.0:1788643157.521676:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacefa21500 x1875527696888064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788643157.521713:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696887424:0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.521773:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.521831:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875527696888192:0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.521863:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.521887:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788643157.521892:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696887552:0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.521915:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.521932:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875527696888320:0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.521950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.521974:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875527696887680:0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.521994:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.522010:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875527696888448:0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.522029:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.522045:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788643157.522050:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696887808:0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.522069:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.522095:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696887936:0@lo:8:kworker.0 00000100:00100000:0.0:1788643157.523368:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.523425:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696888064:0@lo:8:kworker.0 00000100:00100000:0.0:1788643157.523466:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.523509:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696888192 00000100:00100000:0.0:1788643157.523516:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696888192 00000100:00100000:0.0:1788643157.523548:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696888320 00000100:00100000:0.0:1788643157.523551:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696888320 00000100:00100000:0.0:1788643157.523572:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696887680 00000100:00100000:0.0:1788643157.523574:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696887680 00000100:00100000:0.0:1788643157.523583:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696888448 00000100:00100000:0.0:1788643157.523585:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696888448 00000100:00100000:0.0:1788643157.523600:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788643157.523608:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875527696888192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.523677:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875527696888192:12345-0@lo:400:kworker.0 Request processed in 69us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643157.523685:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788643157.523702:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788643157.523708:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875527696888320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643157.524020:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696887424 00000100:00100000:2.0:1788643157.524025:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696887424 00000100:00100000:2.0:1788643157.524064:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788643157.524071:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+21:3642:x1875527696887424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643157.524105:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+21:3642:x1875527696887424:12345-0@lo:400:kworker.0 Request processed in 35us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643157.524111:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788643157.524156:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696887936 00000100:00100000:2.0:1788643157.524160:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696887936 00000100:00100000:2.0:1788643157.524175:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696888064 00000100:00100000:2.0:1788643157.524178:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696888064 00000100:00100000:2.0:1788643157.524188:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788643157.524197:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875527696887936:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788643157.524229:0:24260:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 638 last 0 00000020:00000080:2.0:1788643157.524259:0:24260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x119ccc6e683c3f15 00002000:00100000:2.0:1788643157.524271:0:24260:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9cabc109a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788643157.524275:0:24260:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788643157.524278:0:24260:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788643157.524491:0:24260:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788643157.524523:0:24260:0:(import.c:65:import_set_state_nolock()) ffff9cabc109a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788643157.524576:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875527696887936:12345-0@lo:8:kworker.0 Request processed in 382us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643157.524586:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788643157.524604:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788643157.524618:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875527696888064:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788643157.524633:0:24260:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788643157.525625:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875527696888320:12345-0@lo:400:kworker.0 Request processed in 1913us (3669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643157.525635:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788643157.525662:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788643157.525670:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875527696887680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.525711:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875527696887680:12345-0@lo:400:kworker.0 Request processed in 43us (3715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643157.525717:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788643157.525728:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788643157.525735:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875527696888448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.525763:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875527696888448:12345-0@lo:400:kworker.0 Request processed in 29us (3733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643157.525769:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788643157.525792:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696887552 00000100:00100000:0.0:1788643157.525817:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696887552 00000100:00100000:0.0:1788643157.525844:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696887808 00000100:00100000:0.0:1788643157.525847:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696887808 00000100:00100000:0.0:1788643157.525858:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788643157.525863:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696887552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.525893:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696887552:12345-0@lo:400:kworker.0 Request processed in 29us (3976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643157.525908:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788643157.525921:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788643157.525926:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696887808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.525956:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696887808:12345-0@lo:400:kworker.0 Request processed in 30us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643157.525962:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788643157.525996:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788643157.526000:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788643157.526088:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696887808:0@lo:400:kworker.0 00010000:00080000:0.0:1788643157.526104:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacefa22a00 x1875527696887680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643157.527813:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875527696887680:0@lo:400:kworker.0 00010000:00080000:0.0:1788643157.527844:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacefa22d80 x1875527696888448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643157.527855:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875527696888448:0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.527899:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696887552:0@lo:400:kworker.0 00010000:00080000:0.0:1788643157.527913:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacefa22680 x1875527696888320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643157.527922:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875527696888320:0@lo:400:kworker.0 00000100:00100000:0.0:1788643157.527934:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696887424:0@lo:400:kworker.0 00010000:00080000:0.0:1788643157.527946:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacefa20380 x1875527696888192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643157.527970:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875527696888192:0@lo:400:kworker.0 00010000:00080000:3.0:1788643157.532624:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacefa20a80 x1875527696887936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788643177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643157.532637:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788643157.532647:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788643157.532654:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788643157.532660:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788643157.532663:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc3be4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788643157.532689:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788643157.532695:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696887936:0@lo:8:kworker.0 00000004:00080000:0.0:1788643157.532793:0:23494:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788643157.532823:0:23494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875527696888704:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788643157.532877:0:23494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.532902:0:23494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd056e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788643157.532922:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788643157.532929:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788643157.532998:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788643157.533009:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696888576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788643157.533035:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.533072:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696888704 00000100:00100000:0.0:1788643157.533078:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696888704 00000100:00080000:0.0:1788643157.533126:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788643157.533198:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788643157.533207:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23494:x1875527696888704:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788643157.533463:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696888576 00000100:00100000:3.0:1788643157.533468:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696888576 00000100:00100000:3.0:1788643157.533498:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788643157.533504:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875527696888576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788643157.533520:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788643157.533564:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875527696888576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643157.533571:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788643157.533600:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacf7ff1500 x1875527696888576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788643173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643157.533615:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696888576:0@lo:13:osp-pre-0-1.0 00002000:00080000:3.0:1788643157.544362:0:24706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788643157.544373:0:24706:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788643157.544483:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23494:x1875527696888704:12345-0@lo:7:osp-pre-0-1.0 Request processed in 11273us (11601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643157.544497:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788643157.544599:0:23494:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacf7ff1f80 x1875527696888704/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788643173 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643157.544612:0:23494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875527696888704:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788643157.544626:0:23494:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788643157.544661:0:23494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875527696888832:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788643157.544690:0:23494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.544722:0:23494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd056e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788643157.544763:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696888832 00000100:00100000:3.0:1788643157.544778:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696888832 00000100:00100000:3.0:1788643157.544835:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788643157.544844:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23494:x1875527696888832:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788643157.544868:0:24259:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788643157.544896:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23494:x1875527696888832:12345-0@lo:5:osp-pre-0-1.0 Request processed in 54us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643157.544902:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788643157.544960:0:23494:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacf7ff1f80 x1875527696888832/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788643173 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643157.544981:0:23494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875527696888832:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788643157.544989:0:23494:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788643157.545011:0:23494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875527696888960:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788643157.545033:0:23494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643157.545054:0:23494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd056e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788643157.545092:0:24706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696888960 00000100:00100000:3.0:1788643157.545096:0:24706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696888960 00000100:00100000:3.0:1788643157.545156:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788643157.545163:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23494:x1875527696888960:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788643157.545186:0:24706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:3.0:1788643157.549588:0:23493:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788643157.549692:0:23493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 638786310991ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788643157.549700:0:23493:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1788643157.563679:0:23485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788643157.565514:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875527696888064:12345-0@lo:8:kworker.0 Request processed in 40891us (42040us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788643157.565528:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788643157.566406:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc3245000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788643157.566414:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788643157.566419:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696888064:0@lo:8:kworker.0 00000001:00080000:1.0:1788643157.588017:0:24255:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788643157.588038:0:24255:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788643157.588234:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23494:x1875527696888960:12345-0@lo:5:osp-pre-0-1.0 Request processed in 43068us (43195us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788643157.588263:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788643157.588945:0:23494:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacf7ff1f80 x1875527696888960/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788643173 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643157.588958:0:23494:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788643157.588964:0:23494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875527696888960:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788643157.588978:0:23494:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788643157.589026:0:23494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23494:1875527696889088:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788643157.589065:0:23494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643157.589093:0:23494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd056e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788643157.589427:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696889088 00000100:00100000:2.0:1788643157.589434:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696889088 00000100:00100000:2.0:1788643157.589475:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788643157.589484:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23494:x1875527696889088:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788643157.589534:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23494:x1875527696889088:12345-0@lo:900:osp-pre-0-1.0 Request processed in 52us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643157.589541:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788643157.589662:0:23494:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacc88e8000 x1875527696889088/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788643173 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643157.589673:0:23494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23494:1875527696889088:0@lo:900:osp-pre-0-1.0 00000020:00000004:0.0:1788643157.927693:0:24733:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788643157.927947:0:24733:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788643158.166924:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643158.731686:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788643158.731708:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696889216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788643158.731802:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643158.732041:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696889216 00000100:00100000:0.0:1788643158.732049:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696889216 00000100:00100000:0.0:1788643158.732100:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788643158.732107:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696889216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788643158.732139:0:22757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788643158.732198:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696889216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643158.732206:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788643158.732324:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696889216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788643158.732472:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788643158.732483:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696889344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788643158.732515:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643158.732610:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696889344 00000100:00100000:0.0:1788643158.732615:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696889344 00000100:00100000:0.0:1788643158.732644:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788643158.732651:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696889344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788643158.732669:0:23495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788643158.732712:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696889344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643158.732718:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788643158.732804:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696889344:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788643159.184742:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643160.214861:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643161.228143:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643162.252502:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643162.827914:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696889472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788643162.827994:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788643162.828168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788643162.828172:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788643162.828174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788643162.828177:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788643162.828193:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788643162.828196:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788643162.828199:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cacc3245000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788643162.828204:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 638 00000100:00080000:3.0:1788643162.828209:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788643162.828214:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cacc3245000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:3.0:1788643162.828232:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc88e9c00 x1875527696890112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788643162.828278:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696889472 00000100:00100000:3.0:1788643162.828284:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696889472 00000100:00100000:3.0:1788643162.828330:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788643162.828339:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696889472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788643162.828365:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788643162.828500:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696889472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643162.828507:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788643162.828531:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696889728:0@lo:400:kworker.0 00000100:00100000:3.0:1788643162.828557:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643162.828595:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875527696890368:0@lo:400:kworker.0 00000100:00100000:3.0:1788643162.828622:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643162.828638:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788643162.828643:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875527696889856:0@lo:400:kworker.0 00000100:00100000:3.0:1788643162.828662:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643162.828676:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875527696890496:0@lo:400:kworker.0 00000100:00100000:3.0:1788643162.828695:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643162.828720:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696890112:0@lo:8:kworker.0 00000100:00100000:3.0:1788643162.828751:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788643162.828789:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788643162.828805:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696889728 00000100:00100000:3.0:1788643162.828809:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696889728 00000100:00100000:3.0:1788643162.828836:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788643162.828843:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696889728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643162.828880:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696889728:12345-0@lo:400:kworker.0 Request processed in 38us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643162.828886:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788643162.828906:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696890112 00000100:00100000:3.0:1788643162.828910:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696890112 00000100:00100000:3.0:1788643162.828925:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788643162.828930:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1875527696890112:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788643162.828945:0:24261:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788643162.828977:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1875527696890112:12345-0@lo:8:kworker.0 Request processed in 46us (225us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788643162.828982:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788643162.829033:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc3245000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788643162.829043:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788643162.829047:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696890112:0@lo:8:kworker.0 00000100:00100000:3.0:1788643162.829080:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696889728:0@lo:400:kworker.0 00000100:00100000:1.0:1788643162.829214:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696889600:0@lo:400:kworker.0 00000100:00100000:1.0:1788643162.829249:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643162.829281:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875527696890240:0@lo:400:kworker.0 00000100:00100000:1.0:1788643162.829306:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643162.829326:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788643162.829332:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696889984:0@lo:400:kworker.0 00000100:00100000:1.0:1788643162.829356:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643162.829409:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696889984 00000100:00100000:1.0:1788643162.829423:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696889984 00000100:00100000:1.0:1788643162.829452:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788643162.829458:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696889984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643162.829494:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696889984:12345-0@lo:400:kworker.0 Request processed in 36us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643162.829500:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788643162.829529:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696889984:0@lo:400:kworker.0 00000100:00100000:0.0:1788643162.829856:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696890368 00000100:00100000:0.0:1788643162.829862:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696890368 00000100:00100000:0.0:1788643162.829903:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696889856 00000100:00100000:0.0:1788643162.829907:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696889856 00000100:00100000:0.0:1788643162.829923:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696890496 00000100:00100000:0.0:1788643162.829926:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696890496 00000100:00100000:0.0:1788643162.829941:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696890240 00000100:00100000:0.0:1788643162.829944:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696890240 00000100:00100000:0.0:1788643162.829962:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788643162.829969:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875527696890368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643162.830033:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875527696890368:12345-0@lo:400:kworker.0 Request processed in 64us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643162.830040:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788643162.830058:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788643162.830065:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875527696889856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643162.830101:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875527696889856:12345-0@lo:400:kworker.0 Request processed in 37us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643162.830107:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788643162.830121:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788643162.830127:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875527696890496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643162.830157:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875527696890496:12345-0@lo:400:kworker.0 Request processed in 31us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643162.830164:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788643162.830176:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788643162.830182:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875527696890240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643162.830227:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875527696890240:12345-0@lo:400:kworker.0 Request processed in 45us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643162.830234:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788643162.830279:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacc88eb480 x1875527696889472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788643178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643162.830294:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696889472:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788643162.830325:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacc88eaa00 x1875527696890240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643162.830335:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875527696890240:0@lo:400:kworker.0 00010000:00080000:0.0:1788643162.830361:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacc88e8a80 x1875527696889856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643162.830370:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875527696889856:0@lo:400:kworker.0 00010000:00080000:0.0:1788643162.830404:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacc88e8380 x1875527696890496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643162.830413:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875527696890496:0@lo:400:kworker.0 00000100:00080000:1.0:1788643162.830600:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788643162.830605:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788643162.830648:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacc88ea300 x1875527696890368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643162.830658:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875527696890368:0@lo:400:kworker.0 00000100:00100000:3.0:1788643162.830763:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696889600 00000100:00100000:3.0:1788643162.830778:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696889600 00000100:00100000:3.0:1788643162.830824:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788643162.830832:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:3645:x1875527696889600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643162.830879:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:3645:x1875527696889600:12345-0@lo:400:kworker.0 Request processed in 48us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643162.830887:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788643162.830926:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696889600:0@lo:400:kworker.0 00010000:00010000:3.0:1788643163.275746:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788643163.596015:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788643163.851867:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788643163.851885:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696890624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788643163.851948:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643163.852102:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696890624 00000100:00100000:3.0:1788643163.852111:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696890624 00000100:00100000:3.0:1788643163.852157:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788643163.852165:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696890624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788643163.852197:0:23495:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788643163.852250:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696890624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643163.852257:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788643163.852446:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788643163.852460:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696890752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788643163.852498:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643163.852524:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696890752 00000100:00100000:1.0:1788643163.852528:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696890752 00000100:00100000:1.0:1788643163.852555:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788643163.852561:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696890752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788643163.852578:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788643163.852609:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696890752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643163.852615:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788643163.852658:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696890752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788643163.852969:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696890624:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788643164.300124:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788643164.556315:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788643165.221190:0:25078:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788643165.221193:0:25078:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788643165.221195:0:25078:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788643165.221310:0:25078:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cacf5764800 00000020:01000004:3.0:1788643165.221327:0:25078:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788643165.221341:0:25078:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788643165.221353:0:25078:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cabc7c3cd40) 00000020:00000080:3.0:1788643165.221414:0:25078:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788643165.318442:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788643165.321627:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788643165.322022:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788643165.322311:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788643165.322526:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788643165.322854:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788643165.323157:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00010000:00010000:3.0:1788643165.323525:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:0.0:1788643165.325636:0:25078:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788643165.325875:0:25078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788643165.325892:0:25078:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788643165.325904:0:25078:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x119ccc6e683c3f23 00000020:01000004:0.0:1788643165.325910:0:25078:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788643165.325934:0:25078:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.118@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788643165.325939:0:25078:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788643165.325945:0:25078:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788643165.325976:0:25078:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788643165.325979:0:25078:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788643165.337094:0:25078:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.118@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788643165.337128:0:25078:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.118@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788643165.337132:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788643165.337134:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788643165.337135:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788643165.337137:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788643165.337138:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788643165.337139:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788643165.337141:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788643165.337142:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788643165.337143:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788643165.337146:0:25078:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788643165.337148:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788643165.337150:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788643165.337151:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788643165.337152:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788643165.337153:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788643165.337154:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788643165.337155:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788643165.337156:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788643165.337160:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788643165.337184:0:25078:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788643165.337201:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696890880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788643165.337262:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643165.337298:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd0f673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643165.337482:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696890880 00000100:00100000:3.0:1788643165.337489:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696890880 00000100:00100000:3.0:1788643165.337540:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788643165.337548:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+21:25078:x1875527696890880:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788643165.337573:0:22745:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788643165.337576:0:22745:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788643165.337580:0:22745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788643165.337948:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+21:25078:x1875527696890880:12345-0@lo:253:mount.lustre.0 Request processed in 399us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643165.337957:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788643165.338127:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696890880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788643165.338138:0:25078:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788643165.338140:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788643165.338142:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788643165.338143:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788643165.338144:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788643165.338153:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788643165.338155:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788643165.338156:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788643165.338157:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788643165.338159:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788643165.338175:0:25078:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cacf5764800 from lustre-OST0001 10000000:01000000:2.0:1788643165.338202:0:25078:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788643165.338204:0:25078:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788643165.338212:0:25078:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cacfdc88000 local copy 00010000:00010000:2.0:1788643165.338221:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643165.338300:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643165.338330:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643165.338363:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc1ccb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643165.338479:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696891008 00000100:00100000:3.0:1788643165.338484:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696891008 00000100:00100000:3.0:1788643165.338517:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788643165.338524:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+21:25078:x1875527696891008:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788643165.338694:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+21:25078:x1875527696891008:12345-0@lo:501:mount.lustre.0 Request processed in 170us (362us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788643165.338702:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788643165.338781:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891008:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788643165.338794:0:25078:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788643165.338809:0:25078:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788643165.338815:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643165.338825:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cad02175600/0x119ccc6e683c3c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3c44 expref: -99 pid: 22731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643165.338956:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cacf5764800 10000000:01000000:2.0:1788643165.338962:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788643165.338967:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788643165.338969:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788643165.338973:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788643165.338977:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788643165.338999:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7495800/0x119ccc6e683c3f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643165.339014:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cabc7495800/0x119ccc6e683c3f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643165.339024:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cabc7495800/0x119ccc6e683c3f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643165.339035:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788643165.339063:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643165.339154:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc1ccb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643165.339231:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696891136 00000100:00100000:1.0:1788643165.339236:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696891136 00000100:00100000:1.0:1788643165.339260:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788643165.339267:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:25078:x1875527696891136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788643165.339276:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788643165.339288:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacc0031c00/0x119ccc6e683c3f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3f2a expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643165.339308:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc0031c00/0x119ccc6e683c3f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3f2a expref: 22 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643165.339317:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacc0031c00/0x119ccc6e683c3f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3f2a expref: 22 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643165.339325:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacc0031c00, rc 0) 00000100:00100000:1.0:1788643165.339354:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+22:25078:x1875527696891136:12345-0@lo:101:mount.lustre.0 Request processed in 87us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643165.339359:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788643165.339604:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643165.339619:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cabc7495800/0x119ccc6e683c3f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f31 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643165.339628:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cabc7495800/0x119ccc6e683c3f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3f31 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788643165.341461:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788643165.342199:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788643165.344955:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788643165.345007:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788643165.345026:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788643165.345041:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788643165.345055:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788643165.345069:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788643165.345462:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788643165.345485:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788643165.345506:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788643165.345610:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788643165.345626:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788643165.345724:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643165.346495:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643165.346549:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc1ccbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643165.346919:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696891264 00000100:00100000:1.0:1788643165.346928:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696891264 00000100:00100000:1.0:1788643165.346983:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788643165.346994:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+22:25078:x1875527696891264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788643165.347140:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+22:25078:x1875527696891264:12345-0@lo:501:mount.lustre.0 Request processed in 148us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643165.347159:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788643165.347314:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788643165.347354:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788643165.347425:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643165.347450:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc1ccbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788643165.347544:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696891392 00000100:00100000:0.0:1788643165.347549:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696891392 00000100:00100000:0.0:1788643165.347588:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788643165.347596:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+22:25078:x1875527696891392:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788643165.348917:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+22:25078:x1875527696891392:12345-0@lo:503:mount.lustre.0 Request processed in 1316us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.348928:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788643165.349026:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891392:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788643165.349580:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788643165.349655:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788643165.349705:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643165.349796:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc1ccb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643165.350267:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696891520 00000100:00100000:1.0:1788643165.350273:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696891520 00000100:00100000:1.0:1788643165.350372:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788643165.350407:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+22:25078:x1875527696891520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788643165.350892:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+22:25078:x1875527696891520:12345-0@lo:502:mount.lustre.0 Request processed in 511us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643165.350900:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788643165.350990:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788643165.351174:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788643165.351202:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788643165.351220:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788643165.351235:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788643165.351249:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788643165.351261:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788643165.351274:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788643165.351285:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788643165.351298:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788643165.351325:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788643165.351365:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643165.352026:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc1ccb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643165.352162:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696891648 00000100:00100000:3.0:1788643165.352169:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696891648 00000100:00100000:3.0:1788643165.352207:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788643165.352215:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+22:25078:x1875527696891648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788643165.352326:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+22:25078:x1875527696891648:12345-0@lo:502:mount.lustre.0 Request processed in 111us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643165.352334:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788643165.352434:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788643165.352488:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788643165.352499:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788643165.353526:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788643165.353542:0:25082:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788643165.353549:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643165.353551:0:25082:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788643165.353557:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788643165.353569:0:25082:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cabc7923380) 00000020:00000080:2.0:1788643165.353605:0:25082:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788643165.353612:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788643165.353683:0:25082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cacf5764800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788643165.353692:0:25082:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788643165.353698:0:25082:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x119ccc6e683c3f3f 00010000:00010000:2.0:1788643165.361215:0:25082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788643165.361989:0:25082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1788643165.366930:0:25082:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788643165.368557:0:25082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788643165.368568:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788643165.368574:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643165.368576:0:25082:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788643165.368589:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788643165.368594:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643165.368595:0:25082:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788643165.368599:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788643165.368600:0:25082:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788643165.368603:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788643165.368605:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643165.368606:0:25082:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788643165.368609:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788643165.368611:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643165.368613:0:25082:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788643165.368623:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788643165.368649:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788643165.368652:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788643165.368653:0:25082:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788643165.368657:0:25082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1788643165.369356:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788643165.369454:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788643165.369513:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7495800/0x119ccc6e683c3f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f31 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.369534:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cabc7495800/0x119ccc6e683c3f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f31 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643165.369556:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cacf5764800 from 1 10000000:01000000:0.0:1788643165.369560:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788643165.369696:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.369704:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.369715:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643165.369749:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788643165.369823:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.369878:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf6179480 going to sleep for 11 seconds 00000100:00100000:2.0:1788643165.370188:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696891776 00000100:00100000:2.0:1788643165.370195:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696891776 00000100:00100000:2.0:1788643165.370247:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788643165.370256:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+22:25078:x1875527696891776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788643165.370268:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643165.370280:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c3f4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3f46 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643165.370301:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c3f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3f46 expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643165.370312:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c3f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3f46 expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643165.370320:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7495a00, rc 0) 00000100:00100000:2.0:1788643165.370358:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+23:25078:x1875527696891776:12345-0@lo:101:mount.lustre.0 Request processed in 104us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643165.370365:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788643165.374779:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788643165.374809:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.374822:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788643165.376472:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1788643165.378241:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788643165.378490:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788643165.378515:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788643165.378529:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788643165.378542:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788643165.378555:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788643165.378591:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788643165.378609:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788643165.378623:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788643165.378636:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788643165.378648:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788643165.378663:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788643165.378696:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788643165.378703:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788643165.378795:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643165.378857:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.378902:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccc44fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643165.382412:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696891904 00000100:00100000:3.0:1788643165.382425:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696891904 00000100:00100000:3.0:1788643165.382487:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788643165.382495:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+23:25078:x1875527696891904:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788643165.382633:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+23:25078:x1875527696891904:12345-0@lo:501:mount.lustre.0 Request processed in 138us (3775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643165.382641:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788643165.383903:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696891904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643165.383956:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788643165.384014:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.384056:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccc44fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643165.384437:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696892032 00000100:00100000:3.0:1788643165.384444:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696892032 00000100:00100000:3.0:1788643165.384485:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788643165.384493:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+23:25078:x1875527696892032:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788643165.384599:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+23:25078:x1875527696892032:12345-0@lo:503:mount.lustre.0 Request processed in 107us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643165.384606:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788643165.384749:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892032:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788643165.385265:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788643165.385333:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643165.385377:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.385441:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccc44fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643165.387060:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696892160 00000100:00100000:3.0:1788643165.387071:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696892160 00000100:00100000:3.0:1788643165.387191:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788643165.387200:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+23:25078:x1875527696892160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788643165.387323:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+23:25078:x1875527696892160:12345-0@lo:502:mount.lustre.0 Request processed in 124us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643165.387331:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788643165.387688:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788643165.389179:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788643165.389227:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788643165.389243:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788643165.389257:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788643165.389272:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788643165.389287:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788643165.389312:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788643165.389327:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788643165.389341:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788643165.389355:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788643165.389368:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788643165.389422:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788643165.389490:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.389526:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccc44fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643165.390975:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696892288 00000100:00100000:1.0:1788643165.390987:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696892288 00000100:00100000:1.0:1788643165.391033:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788643165.391041:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+23:25078:x1875527696892288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788643165.391191:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+23:25078:x1875527696892288:12345-0@lo:502:mount.lustre.0 Request processed in 149us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643165.391199:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788643165.392353:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788643165.392474:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788643165.392488:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788643165.393816:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643165.393826:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643165.393828:0:25086:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788643165.393834:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cacf5764800 00000020:00000080:0.0:1788643165.393837:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788643165.393846:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643165.393859:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643165.393861:0:25086:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788643165.393865:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643165.393868:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643165.393869:0:25086:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788643165.393873:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cacf5764800 00000020:00000080:0.0:1788643165.393875:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788643165.393932:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643165.393936:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643165.393937:0:25086:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788643165.393939:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643165.393941:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643165.393943:0:25086:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788643165.393946:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cacf5764800 00000020:00000080:0.0:1788643165.393955:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788643165.393974:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643165.393977:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643165.393979:0:25086:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788643165.393981:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788643165.393983:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643165.393985:0:25086:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788643165.393988:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cacf5764800 00000020:00000080:0.0:1788643165.393989:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788643165.394020:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788643165.394024:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788643165.394025:0:25086:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788643165.394028:0:25086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788643165.396099:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788643165.396138:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788643165.396161:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643165.396173:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643165.396239:0:25078:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788643165.396242:0:25078:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cacf5764800 10000000:01000000:3.0:1788643165.396245:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cacf5764800 10000000:01000000:3.0:1788643165.396248:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788643165.396253:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cacf5764800 from 1 10000000:01000000:3.0:1788643165.396256:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788643165.396287:0:25078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3c200/0x119ccc6e683c3f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643165.396295:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3c200/0x119ccc6e683c3f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643165.396305:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3c200/0x119ccc6e683c3f54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643165.396328:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788643165.396411:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643165.396447:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacda1cf600 going to sleep for 11 seconds 00000100:00100000:1.0:1788643165.396582:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696892416 00000100:00100000:1.0:1788643165.396590:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696892416 00000100:00100000:1.0:1788643165.396637:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788643165.396646:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+23:25078:x1875527696892416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788643165.396658:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788643165.396670:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacc0030c00/0x119ccc6e683c3f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c3f54 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643165.396693:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc0030c00/0x119ccc6e683c3f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c3f54 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643165.396704:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacc0030c00/0x119ccc6e683c3f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3f54 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643165.396721:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacc0030c00, rc 0) 00000100:00100000:1.0:1788643165.396774:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696892416:12345-0@lo:101:mount.lustre.0 Request processed in 129us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643165.396782:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788643165.396838:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788643165.396865:0:25078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3c200/0x119ccc6e683c3f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f5b expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643165.396875:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3c200/0x119ccc6e683c3f54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c3f5b expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788643165.411975:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788643165.412288:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788643165.412567:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788643165.412593:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788643165.412608:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788643165.412622:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788643165.412634:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788643165.412646:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788643165.412658:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788643165.412671:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788643165.412686:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788643165.412699:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788643165.412712:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788643165.412724:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788643165.415419:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788643165.415480:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788643165.415496:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788643165.415510:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788643165.415522:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788643165.415534:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788643165.415557:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788643165.415571:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788643165.415599:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788643165.415614:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788643165.415627:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788643165.415642:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788643165.415654:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788643165.415665:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788643165.415677:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788643165.415690:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788643165.415704:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788643165.415717:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788643165.415728:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788643165.415752:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788643165.415779:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788643165.415792:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788643165.415805:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788643165.415818:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788643165.415844:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788643165.415861:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788643165.415875:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788643165.415887:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788643165.415899:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788643165.415912:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788643165.415925:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788643165.415937:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788643165.415950:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788643165.415962:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788643165.415974:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788643165.415987:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788643165.416134:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788643165.416154:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788643165.416173:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788643165.416187:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788643165.416283:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788643165.416350:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.416419:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccc44fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788643165.418112:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696892544 00000100:00100000:3.0:1788643165.418124:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696892544 00000100:00100000:3.0:1788643165.418184:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788643165.418194:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696892544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788643165.418340:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea757450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696892544:12345-0@lo:501:mount.lustre.0 Request processed in 147us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643165.418346:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788643165.418441:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788643165.418484:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788643165.418530:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643165.418549:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd02f9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788643165.418564:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696892672 00000100:00100000:3.0:1788643165.418567:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696892672 00000100:00100000:3.0:1788643165.418589:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788643165.418595:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696892672:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788643165.418714:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696892672:12345-0@lo:503:mount.lustre.0 Request processed in 118us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643165.418721:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788643165.420095:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892672:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788643165.420528:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788643165.420623:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788643165.420678:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643165.420711:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd02f9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788643165.420729:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696892800 00000100:00100000:3.0:1788643165.420734:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696892800 00000100:00100000:3.0:1788643165.422901:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788643165.422911:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696892800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788643165.423052:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696892800:12345-0@lo:502:mount.lustre.0 Request processed in 143us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643165.423060:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788643165.423129:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788643165.423350:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788643165.423401:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788643165.423418:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788643165.423429:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788643165.423449:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788643165.423459:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788643165.423469:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788643165.423478:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788643165.423488:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788643165.423498:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788643165.423508:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788643165.423518:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788643165.423527:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788643165.423556:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788643165.423571:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788643165.423582:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788643165.423595:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788643165.423608:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788643165.423622:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788643165.423635:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788643165.423646:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788643165.423657:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788643165.423668:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788643165.423680:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788643165.423693:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788643165.423705:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788643165.423718:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788643165.423731:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788643165.428258:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788643165.428311:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788643165.428329:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788643165.428343:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788643165.428355:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788643165.428367:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788643165.428406:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788643165.428424:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788643165.428437:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788643165.428463:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788643165.428477:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788643165.428490:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788643165.428502:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788643165.428513:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788643165.428525:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788643165.428537:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788643165.428551:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788643165.428576:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788643165.428593:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788643165.428606:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788643165.429509:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892928:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788643165.429589:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643165.430934:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd02f9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788643165.433934:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696892928 00000100:00100000:1.0:1788643165.433948:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696892928 00000100:00100000:1.0:1788643165.437764:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788643165.437784:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696892928:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788643165.437953:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696892928:12345-0@lo:502:mount.lustre.0 Request processed in 175us (8363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643165.437961:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788643165.438115:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696892928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788643165.438314:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788643165.438340:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788643165.438375:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696893056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788643165.438436:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643165.440171:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf053a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788643165.440248:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696893056 00000100:00100000:3.0:1788643165.440255:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696893056 00000100:00100000:3.0:1788643165.440294:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788643165.440302:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696893056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788643165.440444:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696893056:12345-0@lo:502:mount.lustre.0 Request processed in 142us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643165.440452:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788643165.446884:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696893056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788643165.446964:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788643165.446977:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788643165.448037:0:25092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788643165.448051:0:25092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cabc79219c0) 00000020:00000080:2.0:1788643165.448073:0:25092:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788643165.448150:0:25092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cacf5764800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788643165.448154:0:25092:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cacf5764800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788643165.448156:0:25092:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cacf5764800 3 00010000:00080000:2.0:1788643165.448185:0:25092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cabc1099000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.118@tcp at head 00010000:00010000:2.0:1788643165.449862:0:25092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788643165.450068:0:25092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788643165.450113:0:25092:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788643165.450127:0:25092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x119ccc6e683c3f69 00000100:00080000:2.0:1788643165.450138:0:25092:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788643165.450144:0:25092:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cabc1099000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643165.450181:0:25092:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7457100 x1875527696893184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788643165.450225:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875527696893184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788643165.454272:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788643165.454334:0:25092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788643165.454408:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788643165.454412:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788643165.454415:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788643165.454417:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788643165.454448:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788643165.454460:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788643165.454464:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cacc3245000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788643165.454470:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 644 00000100:00080000:2.0:1788643165.454475:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788643165.454482:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cacc3245000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643165.454505:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7454e00 x1875527696893824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788643165.454566:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875527696893440:0@lo:400:kworker.0 00000100:00100000:2.0:1788643165.454600:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643165.454618:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875527696894080:0@lo:400:kworker.0 00000100:00100000:2.0:1788643165.454639:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643165.454657:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788643165.454663:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696893312:0@lo:400:kworker.0 00000100:00100000:2.0:1788643165.454685:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643165.454703:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875527696893952:0@lo:400:kworker.0 00000100:00100000:2.0:1788643165.454723:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.454890:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696893184 00000100:00100000:0.0:1788643165.454899:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696893184 00000100:00100000:0.0:1788643165.454922:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696893440 00000100:00100000:0.0:1788643165.454924:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696893440 00000100:00100000:0.0:1788643165.454942:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696894080 00000100:00100000:0.0:1788643165.454944:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696894080 00000100:00100000:0.0:1788643165.454965:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696893952 00000100:00100000:0.0:1788643165.454968:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696893952 00000100:00100000:0.0:1788643165.454982:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788643165.454989:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875527696893440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643165.455047:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875527696893440:12345-0@lo:400:kworker.0 Request processed in 58us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.455053:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788643165.455069:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788643165.455075:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875527696894080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643165.455102:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875527696894080:12345-0@lo:400:kworker.0 Request processed in 28us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.455108:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788643165.455119:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788643165.455124:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875527696893952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643165.455150:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875527696893952:12345-0@lo:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.455156:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788643165.455167:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788643165.455179:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875527696893184:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788643165.455199:0:22752:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 646 last 0 00000020:00000080:0.0:1788643165.455240:0:22752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x119ccc6e683c3f70 00000004:00100000:0.0:1788643165.455254:0:22752:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788643165.455283:0:22752:0:(import.c:65:import_set_state_nolock()) ffff9cabc7db3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788643165.455317:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875527696893184:12345-0@lo:38:llog_process_th.0 Request processed in 136us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.455323:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788643165.455347:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696893696:0@lo:400:kworker.0 00000100:00100000:0.0:1788643165.455373:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.455416:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788643165.455422:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696893568:0@lo:400:kworker.0 00000100:00100000:0.0:1788643165.455445:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.455464:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875527696894208:0@lo:400:kworker.0 00000100:00100000:0.0:1788643165.455485:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.455508:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696894208 00000100:00100000:0.0:1788643165.455511:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696894208 00000100:00100000:0.0:1788643165.455533:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788643165.455539:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875527696894208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643165.455573:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875527696894208:12345-0@lo:400:kworker.0 Request processed in 34us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.455579:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788643165.455607:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788643165.455611:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788643165.455620:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696893312 00000100:00100000:0.0:1788643165.455623:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696893312 00000100:00100000:0.0:1788643165.455654:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696893568 00000100:00100000:0.0:1788643165.455657:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696893568 00000100:00100000:0.0:1788643165.455669:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788643165.455674:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696893312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643165.455707:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696893312:12345-0@lo:400:kworker.0 Request processed in 32us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.455713:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788643165.455725:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788643165.455730:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696893568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643165.456425:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696893568:12345-0@lo:400:kworker.0 Request processed in 691us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.456432:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788643165.456476:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696893568:0@lo:400:kworker.0 00010000:00080000:0.0:1788643165.456491:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacf7f06d80 x1875527696894208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643165.456500:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875527696894208:0@lo:400:kworker.0 00000100:00100000:2.0:1788643165.456587:0:24706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696893696 00000100:00100000:2.0:1788643165.456592:0:24706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696893696 00000100:00100000:2.0:1788643165.456638:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788643165.456645:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696893696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643165.456682:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696893696:12345-0@lo:400:kworker.0 Request processed in 38us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643165.456688:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788643165.456710:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696893824:0@lo:8:kworker.0 00000100:00100000:2.0:1788643165.456811:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788643165.456848:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cabc7457100 x1875527696893184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788643175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643165.456938:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788643165.456945:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788643165.456952:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788643165.456957:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788643165.456960:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc1099000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788643165.456966:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875527696893184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788643165.456997:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7456a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696893312:0@lo:400:kworker.0 00010000:00080000:2.0:1788643165.457009:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cabc7457480 x1875527696893952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643165.457018:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875527696893952:0@lo:400:kworker.0 00010000:00080000:2.0:1788643165.457028:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cabc7456300 x1875527696893440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643165.457036:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875527696893440:0@lo:400:kworker.0 00010000:00080000:2.0:1788643165.457046:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacf7f04000 x1875527696894080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643165.457053:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875527696894080:0@lo:400:kworker.0 00000100:00100000:3.0:1788643165.457280:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696893824 00000100:00100000:3.0:1788643165.457285:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696893824 00000100:00100000:3.0:1788643165.457308:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788643165.457314:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1875527696893824:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788643165.457361:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1875527696893824:12345-0@lo:8:kworker.0 Request processed in 45us (622us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788643165.457367:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788643165.457449:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788643165.457473:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cabc7455f80 x1875527696893696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788643181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643165.457482:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696893696:0@lo:400:kworker.0 00000020:01000004:0.0:1788643165.458017:0:25092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788643165.458029:0:25092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9cabc7a38000) 00000020:00000080:0.0:1788643165.458047:0:25092:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788643165.458122:0:25092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cacf5764800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788643165.458127:0:25092:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cacf5764800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788643165.458129:0:25092:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cacf5764800 3 00010000:00080000:0.0:1788643165.458163:0:25092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cabc8fee800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.118@tcp at head 00000100:00100000:2.0:1788643165.458887:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788643165.458894:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc3245000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788643165.458898:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788643165.458902:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696893824:0@lo:8:kworker.0 00010000:00010000:2.0:1788643165.463946:0:25092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788643165.464248:0:25092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788643165.464303:0:25092:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788643165.464316:0:25092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x119ccc6e683c3f7e 00000100:00080000:2.0:1788643165.464326:0:25092:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788643165.464331:0:25092:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9cabc8fee800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:2.0:1788643165.464362:0:25092:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacf7f04000 x1875527696894336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788643165.465184:0:25092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788643165.465346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788643165.465351:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788643165.465353:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788643165.465356:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788643165.465511:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1875527696894336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788643165.465577:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.465670:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696894336 00000100:00100000:0.0:1788643165.465677:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696894336 00000100:00100000:0.0:1788643165.465716:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788643165.465725:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1875527696894336:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788643165.465861:0:24283:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 646 last 0 00000020:00000080:0.0:1788643165.465893:0:24283:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x119ccc6e683c3f85 00000004:00100000:0.0:1788643165.465906:0:24283:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788643165.465938:0:24283:0:(import.c:65:import_set_state_nolock()) ffff9cabc8fe8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788643165.465999:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875527696894336:12345-0@lo:38:llog_process_th.0 Request processed in 274us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.466006:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788643165.466437:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cacf7f04000 x1875527696894336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788643175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643165.466448:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788643165.466454:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788643165.466461:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788643165.466465:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788643165.466467:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc8fee800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788643165.466472:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1875527696894336:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788643165.467720:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788643165.467800:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788643165.467829:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788643165.467842:0:25078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3c200/0x119ccc6e683c3f54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f5b expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643165.467860:0:25078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3c200/0x119ccc6e683c3f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c3f5b expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788643165.467909:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788643165.467911:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788643165.467912:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788643165.467913:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788643165.467914:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788643165.467915:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788643165.467917:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788643165.467918:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788643165.467920:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788643165.467923:0:25078:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788643165.467926:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788643165.467927:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788643165.467928:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788643165.467930:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788643165.467931:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788643165.467932:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788643165.467933:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788643165.467934:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788643165.467935:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788643165.467953:0:25078:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788643165.467968:0:25078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696894464:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788643165.468017:0:25078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643165.468049:0:25078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacf053a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788643165.471435:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696894464 00000100:00100000:0.0:1788643165.471449:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696894464 00000100:00100000:0.0:1788643165.471501:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788643165.471510:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696894464:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788643165.471545:0:22745:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788643165.471560:0:22745:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788643165.478717:0:22745:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788643165.478806:0:22745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788643165.479112:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+24:25078:x1875527696894464:12345-0@lo:253:mount.lustre.0 Request processed in 7599us (11090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.479124:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788643165.479237:0:25078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:da540a41-a984-4ac4-89dc-6d833e36a776:25078:1875527696894464:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788643165.479251:0:25078:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788643165.479254:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788643165.479256:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788643165.479257:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788643165.479258:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788643165.479259:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788643165.479270:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788643165.479272:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788643165.479274:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788643165.479275:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788643165.479291:0:25078:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788643165.480460:0:22768:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788643165.480466:0:22768:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000001:00000004:1.0:1788643165.482339:0:25078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:0.0:1788643165.482813:0:22768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.482832:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cacf6d3c800/0x119ccc6e683c3f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3ef9 expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.482849:0:22768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cacf6d3d800/0x119ccc6e683c3f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3f07 expref: 23 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.482856:0:22768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.482894:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cacf6d3d800/0x119ccc6e683c3f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3f07 expref: 23 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.482907:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cacf6d3d800/0x119ccc6e683c3f0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3f07 expref: 23 pid: 22746 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643165.482921:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696894592:0@lo:104: 00000100:00100000:0.0:1788643165.482979:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788643165.483030:0:22768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cacf6d3c800/0x119ccc6e683c3f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3ef9 expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483038:0:22768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cacf6d3c800/0x119ccc6e683c3f00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3ef9 expref: 23 pid: 22745 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643165.483046:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7ff1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696894720:0@lo:104: 00000100:00100000:0.0:1788643165.483068:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.483085:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9caccc44f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788643165.483110:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696894592 00000100:00100000:0.0:1788643165.483116:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696894592 00000100:00100000:0.0:1788643165.483147:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696894720 00000100:00100000:0.0:1788643165.483149:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696894720 00000100:00100000:0.0:1788643165.483163:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788643165.483171:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+4:22768:x1875527696894592:12345-0@lo:104: 00010000:00010000:0.0:1788643165.483189:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483239:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788643165.483245:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+4:22768:x1875527696894592:12345-0@lo:104: Request processed in 75us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.483252:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788643165.483269:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788643165.483275:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7454e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+3:22768:x1875527696894720:12345-0@lo:104: 00010000:00010000:0.0:1788643165.483282:0:22736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483316:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788643165.483321:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7454e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:da540a41-a984-4ac4-89dc-6d833e36a776+3:22768:x1875527696894720:12345-0@lo:104: Request processed in 46us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.483326:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788643165.483344:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788643165.483349:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483356:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3cc00 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643165.483360:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483368:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643165.483374:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643165.483405:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788643165.483434:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483441:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788643165.483460:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483467:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3cc00/0x119ccc6e683c3f07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3f0e expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483482:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643165.483484:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483489:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0031400 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:0.0:1788643165.483492:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483498:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788643165.483504:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643165.483510:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788643165.483522:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483528:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788643165.483549:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483555:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc0031400/0x119ccc6e683c3ef9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3f00 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.483568:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643165.483570:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643165.483571:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643165.483577:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643165.484483:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696894848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643165.484529:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.484594:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696894976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643165.484617:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643165.484652:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696894848 00000100:00100000:0.0:1788643165.484658:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696894848 00010000:00010000:0.0:1788643165.484680:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cacf6d3d800/0x119ccc6e683c3f0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3f07 expref: 24 pid: 22746 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643165.484703:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696894976 00000100:00100000:0.0:1788643165.484707:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696894976 00010000:00010000:0.0:1788643165.484718:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cacf6d3c800/0x119ccc6e683c3f00 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3ef9 expref: 25 pid: 22745 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643165.484736:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788643165.484814:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+25:3645:x1875527696894848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788643165.484825:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788643165.484831:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cacf6d3d800/0x119ccc6e683c3f0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3f07 expref: 25 pid: 22746 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.484854:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cacf6d3d800/0x119ccc6e683c3f0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3f07 expref: 25 pid: 22746 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.484870:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788643165.484903:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+25:3645:x1875527696894848:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.484910:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788643165.484927:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788643165.484933:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7456a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+24:3642:x1875527696894976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788643165.484940:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788643165.484945:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cacf6d3c800/0x119ccc6e683c3f00 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3ef9 expref: 24 pid: 22745 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.484953:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cacf6d3c800/0x119ccc6e683c3f00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3ef9 expref: 24 pid: 22745 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.484965:0:22739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.484972:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788643165.484984:0:22739:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006594089s 00010000:00010000:0.0:1788643165.484988:0:22739:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.484994:0:22739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.485010:0:22739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.485017:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.485022:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7aa400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643165.485027:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.485035:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.485043:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.485053:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788643165.485081:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7456a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+24:3642:x1875527696894976:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643165.485088:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788643165.485128:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696894976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788643165.485155:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696894848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788643165.485179:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacf6d3d800/0x119ccc6e683c3f0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3f07 expref: 23 pid: 22746 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643165.485189:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696894592:0@lo:104: 00010000:00010000:0.0:1788643165.485200:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacf6d3c800/0x119ccc6e683c3f00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3ef9 expref: 22 pid: 22745 timeout: 746 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643165.485218:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7ff1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22768:1875527696894720:0@lo:104: 00010000:00010000:0.0:1788643165.485234:0:22768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.485242:0:22768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.485247:0:22768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643165.485252:0:22768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacfe7aa400/0x119ccc6e683c3f8c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788643165.489635:0:25078:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788643165.489654:0:25078:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788643165.489690:0:25078:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788643165.489733:0:25078:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788643165.489771:0:25078:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788643165.489798:0:25078:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788643165.490576:0:25078:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788643165.490819:0:25078:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788643166.347566:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643166.475544:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643146/real 1788643146] req@ffff9cacf7f02a00 x1875527696881152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643166 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643166.475575:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cacf7f02a00 x1875527696881152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643166 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643166.475584:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788643146/real 1788643146] req@ffff9cacf7f00e00 x1875527696881280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643166 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643166.475594:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cacf7f00e00 x1875527696881280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788643166 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788643166.475612:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788643166.475634:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788643166.475638:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696881152:0@lo:8:kworker.0 00000100:00080000:2.0:1788643166.475644:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc7914800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788643166.475649:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:1.0:1788643166.475801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788643166.475805:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788643166.475807:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788643166.475811:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 627 00000100:00080000:1.0:1788643166.475824:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788643166.475830:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cabc89e5000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788643166.475851:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7ece300 x1875527696895360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788643166.475862:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788643166.475864:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788643166.475866:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cabc7914800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788643166.475869:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 627 00000100:00080000:1.0:1788643166.475871:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788643166.475874:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cabc7914800 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788643166.475885:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cabc7ecd880 x1875527696895488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788643166.475927:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788643166.475930:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788643166.475931:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cacc3245000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788643166.475936:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cacc3245000 using connection 192.168.206.118@tcp/0@lo 00000100:00100000:1.0:1788643166.475945:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cacc9998700 x1875527696896000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788643166.476068:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696881280:0@lo:8:kworker.0 00000100:00100000:2.0:1788643166.476105:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696895360:0@lo:8:kworker.0 00000100:00100000:2.0:1788643166.476164:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643166.476209:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696895488:0@lo:8:kworker.0 00000100:00100000:2.0:1788643166.476232:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643166.476249:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696896000:0@lo:8:kworker.0 00000100:00100000:2.0:1788643166.476268:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643166.476318:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696895360 00000100:00100000:2.0:1788643166.476324:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696895360 00000100:00100000:2.0:1788643166.476350:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696895488 00000100:00100000:2.0:1788643166.476353:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696895488 00000100:00100000:2.0:1788643166.476360:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696896000 00000100:00100000:2.0:1788643166.476362:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696896000 00000100:00100000:2.0:1788643166.476373:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788643166.476401:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1875527696895360:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788643166.476428:0:24261:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:2.0:1788643166.476454:0:24261:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x119ccc6e683c3f93 00002000:00100000:2.0:1788643166.476466:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cabc109f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788643166.476470:0:24261:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788643166.476473:0:24261:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788643166.476538:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788643166.476558:0:24261:0:(import.c:65:import_set_state_nolock()) ffff9cabc109d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788643166.476602:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875527696895360:12345-0@lo:8:kworker.0 Request processed in 221us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643166.476609:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788643166.476623:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788643166.476627:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1875527696895488:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788643166.476641:0:24261:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000100:00100000:1.0:1788643166.476895:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788643166.476900:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1875527696896000:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788643166.476914:0:24706:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000100:00100000:0.0:1788643166.477053:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da540a41-a984-4ac4-89dc-6d833e36a776:3643:1875527696895104:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.477099:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.477134:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696895872:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.477156:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.477168:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875527696896512:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.477192:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.477213:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788643166.477219:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696895744:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.477240:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.477258:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875527696896384:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.477279:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.477307:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696895232:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.477338:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.477357:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875527696896128:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.477376:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.477412:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875527696896640:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.477436:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.477455:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788643166.477461:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875527696895616:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.477480:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.477491:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875527696896256:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.477509:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.477532:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788643166.477539:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788643166.477553:0:24260:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788643166.477559:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696895872 00000100:00100000:0.0:1788643166.477563:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696895872 00000100:00100000:0.0:1788643166.477588:0:24260:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788643166.477594:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788643166.477600:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696895872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.477640:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7455f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696895872:12345-0@lo:400:kworker.0 Request processed in 39us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.477646:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:00000080:2.0:1788643166.477766:0:24261:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x119ccc6e683c3f9a 00002000:00100000:2.0:1788643166.477778:0:24261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cabc109b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788643166.477782:0:24261:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788643166.477785:0:24261:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788643166.477959:0:24261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1788643166.478167:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696895104 00000100:00100000:0.0:1788643166.478174:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696895104 00000100:00100000:0.0:1788643166.478202:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788643166.478209:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+22:3643:x1875527696895104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.478245:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+22:3643:x1875527696895104:12345-0@lo:400:kworker.0 Request processed in 37us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.478259:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788643166.478287:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696896512 00000100:00100000:0.0:1788643166.478290:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696896512 00000100:00100000:0.0:1788643166.478315:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696896384 00000100:00100000:0.0:1788643166.478318:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696896384 00000100:00100000:0.0:1788643166.478328:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696896128 00000100:00100000:0.0:1788643166.478331:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696896128 00000100:00100000:0.0:1788643166.478342:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696896640 00000100:00100000:0.0:1788643166.478344:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696896640 00000100:00100000:0.0:1788643166.478356:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696895616 00000100:00100000:0.0:1788643166.478358:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696895616 00000100:00100000:0.0:1788643166.478368:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696896256 00000100:00100000:0.0:1788643166.478370:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696896256 00000100:00100000:0.0:1788643166.478397:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788643166.478403:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875527696896512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.478436:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875527696896512:12345-0@lo:400:kworker.0 Request processed in 33us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.478443:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788643166.478455:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788643166.478461:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875527696896384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.478487:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875527696896384:12345-0@lo:400:kworker.0 Request processed in 27us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.478494:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788643166.478506:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788643166.478511:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875527696896128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.478541:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875527696896128:12345-0@lo:400:kworker.0 Request processed in 30us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.478547:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788643166.478567:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788643166.478573:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875527696896640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.478602:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875527696896640:12345-0@lo:400:kworker.0 Request processed in 29us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.478608:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788643166.478618:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788643166.478623:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875527696895616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.478650:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875527696895616:12345-0@lo:400:kworker.0 Request processed in 27us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.479421:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788643166.479440:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788643166.479448:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875527696896256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.479493:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875527696896256:12345-0@lo:400:kworker.0 Request processed in 47us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.479499:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788643166.479519:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696895744 00000100:00100000:0.0:1788643166.479525:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696895744 00000100:00100000:0.0:1788643166.479601:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696895232 00000100:00100000:0.0:1788643166.479605:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696895232 00000020:00000080:1.0:1788643166.479682:0:24706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x119ccc6e683c3fa1 00002000:00100000:1.0:1788643166.479696:0:24706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9cacd70bb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788643166.479700:0:24706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788643166.479709:0:24706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788643166.479783:0:24706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788643166.479810:0:24706:0:(import.c:65:import_set_state_nolock()) ffff9cacd70bb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788643166.479847:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3641:x1875527696896000:12345-0@lo:8:kworker.0 Request processed in 2946us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643166.479855:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788643166.482095:0:24261:0:(import.c:65:import_set_state_nolock()) ffff9cabc7db3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788643166.482183:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875527696895488:12345-0@lo:8:kworker.0 Request processed in 5551us (5946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643166.482193:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788643166.482245:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7ece300 x1875527696895360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788643191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643166.482257:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788643166.482265:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788643166.482272:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788643166.482277:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788643166.482280:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc89e5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788643166.482303:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788643166.482309:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696895360:0@lo:8:kworker.0 00010000:00080000:2.0:1788643166.482324:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7ecd880 x1875527696895488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788643191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643166.482331:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788643166.482334:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788643166.482338:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788643166.482341:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788643166.482343:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cabc7914800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788643166.482353:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788643166.482356:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875527696895488:0@lo:8:kworker.0 00010000:00080000:2.0:1788643166.482370:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc9998700 x1875527696896000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788643191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788643166.482402:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788643166.482407:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788643166.482409:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788643166.482417:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9cacc3245000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788643166.482426:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788643166.482429:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875527696896000:0@lo:8:kworker.0 00000004:00080000:2.0:1788643166.482460:0:22778:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788643166.482541:0:22778:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 647719159913ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788643166.482547:0:22778:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788643166.484192:0:22732:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788643166.484694:0:22777:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788643166.484718:0:22777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22777:1875527696896896:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788643166.484851:0:22777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643166.484878:0:22777:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc668e180 going to sleep for 11 seconds 00000004:00080000:1.0:1788643166.484913:0:23497:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788643166.484929:0:23497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f00e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1875527696897152:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788643166.484951:0:23497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643166.484966:0:23497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc668e900 going to sleep for 11 seconds 00000004:00080000:1.0:1788643166.484978:0:23496:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788643166.485055:0:23496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 647721672699ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788643166.485061:0:23496:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788643166.485529:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1788643166.485667:0:22776:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788643166.485720:0:22776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 647722338266ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788643166.485725:0:22776:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788643166.485778:0:22779:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1788643166.485792:0:22779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22779:1875527696897408:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788643166.485829:0:22779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643166.485849:0:22779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd02f9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788643166.485929:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696896896 00000100:00100000:3.0:1788643166.485936:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696896896 00000100:00100000:3.0:1788643166.485971:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696897152 00000100:00100000:3.0:1788643166.485973:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696897152 00000100:00100000:3.0:1788643166.485985:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696897408 00000100:00100000:3.0:1788643166.485987:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696897408 00000100:00100000:3.0:1788643166.485998:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788643166.486005:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22777:x1875527696896896:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788643166.488435:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788643166.488455:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23497:x1875527696897152:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788643166.489042:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696895744:12345-0@lo:400:kworker.0 00002000:00080000:3.0:1788643166.493283:0:24261:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788643166.493294:0:24261:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1788643166.493300:0:24261:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000100:00100000:0.0:1788643166.494348:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788643166.494363:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696895232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.494479:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696895232:12345-0@lo:400:kworker.0 Request processed in 120us (17139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.494486:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788643166.494611:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696897280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788643166.495510:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788643166.495578:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc999b480 x1875527696896384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643166.495593:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875527696896384:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.495606:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da540a41-a984-4ac4-89dc-6d833e36a776:3643:1875527696895104:0@lo:400:kworker.0 00010000:00080000:0.0:1788643166.495618:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc9998e00 x1875527696895872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788643182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643166.495626:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696895872:0@lo:400:kworker.0 00010000:00080000:0.0:1788643166.495639:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc999b800 x1875527696896512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643166.495647:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875527696896512:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.495928:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788643166.495938:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696897024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788643166.495977:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788643166.496019:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788643166.496024:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788643166.496028:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788643166.496030:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788643166.496054:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc999bb80 x1875527696895616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643166.496064:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875527696895616:0@lo:400:kworker.0 00010000:00080000:0.0:1788643166.496819:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc999b100 x1875527696896256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643166.496832:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc999b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875527696896256:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.496853:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696895232:0@lo:400:kworker.0 00010000:00080000:0.0:1788643166.496877:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacc9999f80 x1875527696896128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643166.496886:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875527696896128:0@lo:400:kworker.0 00010000:00080000:0.0:1788643166.496898:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacf7f00a80 x1875527696896640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643166.496905:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875527696896640:0@lo:400:kworker.0 00000100:00100000:0.0:1788643166.496932:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788643166.496941:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696896768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788643166.496984:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.497051:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696897280 00000100:00100000:0.0:1788643166.497058:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696897280 00000100:00100000:0.0:1788643166.498240:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696897024 00000100:00100000:0.0:1788643166.498248:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696897024 00000100:00100000:0.0:1788643166.498269:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696896768 00000100:00100000:0.0:1788643166.498272:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696896768 00000100:00100000:0.0:1788643166.498288:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788643166.498296:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875527696897280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788643166.498319:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915866112 avail 3684343808 00000100:00100000:0.0:1788643166.498413:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875527696897280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (3758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.498420:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788643166.498439:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788643166.498445:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875527696897024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788643166.498455:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915866112 avail 3684343808 00000100:00100000:0.0:1788643166.498481:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1875527696897024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.498496:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788643166.498509:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788643166.498515:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875527696896768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788643166.498544:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788643166.498583:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875527696896768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.498589:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788643166.498630:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacf7f02680 x1875527696896768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788643182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643166.498648:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696896768:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788643166.499851:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacf7f01500 x1875527696897024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788643182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643166.499870:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696897024:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788643166.499884:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7bbca80 x1875527696897280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788643182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643166.499894:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696897280:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1788643166.500192:0:24706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788643166.500198:0:24706:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788643166.500262:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23497:x1875527696897152:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11814us (15308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643166.500271:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788643166.500303:0:23497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacf7f00e00 x1875527696897152/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788643182 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643166.500312:0:23497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f00e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1875527696897152:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788643166.500322:0:23497:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788643166.500354:0:23497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f07b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1875527696897536:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788643166.501298:0:25142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788643166.501311:0:25142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22779:x1875527696897408:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788643166.502411:0:23497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643166.502448:0:23497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc668e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788643166.503963:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696897536 00000100:00100000:1.0:1788643166.503975:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696897536 00000100:00100000:1.0:1788643166.504027:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788643166.504036:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23497:x1875527696897536:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788643166.504064:0:24260:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788643166.504222:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23497:x1875527696897536:12345-0@lo:5:osp-pre-1-1.0 Request processed in 187us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643166.504229:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788643166.504313:0:23497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacf7f07b80 x1875527696897536/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788643182 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643166.504328:0:23497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f07b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1875527696897536:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788643166.504341:0:23497:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788643166.504400:0:23497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1875527696897664:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788643166.504435:0:23497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643166.504454:0:23497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc6a256c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643166.504465:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696897664 00000100:00100000:1.0:1788643166.504468:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696897664 00000100:00100000:1.0:1788643166.504490:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788643166.504497:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23497:x1875527696897664:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788643166.504535:0:24260:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00080000:0.0:1788643166.508341:0:25142:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788643166.508352:0:25142:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788643166.508357:0:25142:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000100:00100000:2.0:1788643166.510779:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696895744:12345-0@lo:400:kworker.0 Request processed in 25233us (33529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643166.510793:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788643166.511205:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc9998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696895744:0@lo:400:kworker.0 00000004:00080000:2.0:1788643166.515266:0:23485:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1788643166.518819:0:22732:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788643166.518944:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.518954:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77351d5/0x119ccc6e683c3fa8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.518982:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.518986:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.518993:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d77351d5/0x119ccc6e683c3fa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.519010:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d77351d5/0x119ccc6e683c3fa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.519021:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d77351d5/0x119ccc6e683c3fa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.519028:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d77351d5/0x119ccc6e683c3fa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.519048:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788643166.522006:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.522018:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c3faf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.522034:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.522039:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.522045:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c3faf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.522057:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c3faf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.522091:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c3faf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.522099:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c3faf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.522119:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788643166.522923:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.522929:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c3fb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.522939:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.522942:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.522946:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c3fb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.522955:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c3fb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.522963:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c3fb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.522969:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c3fb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.522988:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788643166.524905:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.524915:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c3fbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.524929:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.524933:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.524939:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c3fbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.524950:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c3fbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.524959:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c3fbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.524967:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c3fbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.524977:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788643166.526323:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.526332:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bba92e6/0x119ccc6e683c3fc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.526343:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.526353:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.526358:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bba92e6/0x119ccc6e683c3fc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.526368:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bba92e6/0x119ccc6e683c3fc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.526377:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bba92e6/0x119ccc6e683c3fc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.526403:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bba92e6/0x119ccc6e683c3fc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.526414:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788643166.527616:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.527625:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095dffd4f/0x119ccc6e683c3fcb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.527647:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.527651:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.528807:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095dffd4f/0x119ccc6e683c3fcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.528831:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095dffd4f/0x119ccc6e683c3fcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.528842:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095dffd4f/0x119ccc6e683c3fcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.528849:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095dffd4f/0x119ccc6e683c3fcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.528860:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788643166.530855:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.530867:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f15ae439/0x119ccc6e683c3fd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.530882:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.530887:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.530893:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f15ae439/0x119ccc6e683c3fd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.530906:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f15ae439/0x119ccc6e683c3fd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.530929:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f15ae439/0x119ccc6e683c3fd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.530938:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f15ae439/0x119ccc6e683c3fd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.530950:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788643166.532263:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.532274:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4b5043b/0x119ccc6e683c3fd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.532287:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.532291:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.532297:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b5043b/0x119ccc6e683c3fd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.532309:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4b5043b/0x119ccc6e683c3fd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.532319:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4b5043b/0x119ccc6e683c3fd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.532327:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b5043b/0x119ccc6e683c3fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.532347:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788643166.534963:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.534975:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbf897ee/0x119ccc6e683c3fe0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.534991:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.534995:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.535001:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbf897ee/0x119ccc6e683c3fe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.535013:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbf897ee/0x119ccc6e683c3fe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.535023:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbf897ee/0x119ccc6e683c3fe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.535031:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbf897ee/0x119ccc6e683c3fe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.535041:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:0.0:1788643166.536941:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788643166.536951:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d77351d5/0x119ccc6e683c3fa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.536965:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3c600 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.536970:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77351d5/0x119ccc6e683c3fa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.536979:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d77351d5/0x119ccc6e683c3fa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.537009:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d77351d5/0x119ccc6e683c3fa8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.537018:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d77351d5/0x119ccc6e683c3fa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.537039:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788643166.537043:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c3faf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.537050:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3c400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.537054:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c3faf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.537062:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c3faf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.537072:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c3faf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788643166.537312:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.537320:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001766574a/0x119ccc6e683c3fe7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.537330:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.537341:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.537346:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001766574a/0x119ccc6e683c3fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.537358:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001766574a/0x119ccc6e683c3fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.537367:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001766574a/0x119ccc6e683c3fe7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.537373:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001766574a/0x119ccc6e683c3fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.537421:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788643166.537910:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.537917:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c3fee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.537926:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.537929:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.537933:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c3fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.537941:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c3fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.537949:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c3fee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.537963:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c3fee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.537972:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:0.0:1788643166.538801:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c3faf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538823:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788643166.538827:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c3fb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538841:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3d000 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.538846:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c3fb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538855:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c3fb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538871:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c3fb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538879:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c3fb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538891:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788643166.538894:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c3fbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538900:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3d600 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.538904:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c3fbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538911:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c3fbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538919:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c3fbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538931:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c3fbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538944:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788643166.538947:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bba92e6/0x119ccc6e683c3fc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538953:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3da00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.538956:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bba92e6/0x119ccc6e683c3fc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538963:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bba92e6/0x119ccc6e683c3fc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538972:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bba92e6/0x119ccc6e683c3fc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538979:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bba92e6/0x119ccc6e683c3fc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.538991:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788643166.538994:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095dffd4f/0x119ccc6e683c3fcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.539001:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495600 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.539010:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095dffd4f/0x119ccc6e683c3fcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.539017:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095dffd4f/0x119ccc6e683c3fcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.539027:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095dffd4f/0x119ccc6e683c3fcb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.539033:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095dffd4f/0x119ccc6e683c3fcb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.539047:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788643166.539051:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f15ae439/0x119ccc6e683c3fd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.539057:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494200 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.539060:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f15ae439/0x119ccc6e683c3fd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.539067:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f15ae439/0x119ccc6e683c3fd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788643166.539246:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.539252:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c3ff5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.539262:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.539266:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.539270:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c3ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.539280:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c3ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.539288:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c3ff5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.539294:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c3ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.539302:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788643166.540173:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f15ae439/0x119ccc6e683c3fd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540188:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f15ae439/0x119ccc6e683c3fd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540218:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788643166.540222:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4b5043b/0x119ccc6e683c3fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540229:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.540232:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b5043b/0x119ccc6e683c3fd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540240:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b5043b/0x119ccc6e683c3fd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540253:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4b5043b/0x119ccc6e683c3fd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540259:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b5043b/0x119ccc6e683c3fd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540269:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788643166.540272:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbf897ee/0x119ccc6e683c3fe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540278:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494c00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.540281:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbf897ee/0x119ccc6e683c3fe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540296:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbf897ee/0x119ccc6e683c3fe0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540305:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbf897ee/0x119ccc6e683c3fe0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540312:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbf897ee/0x119ccc6e683c3fe0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540323:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788643166.540326:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001766574a/0x119ccc6e683c3fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540331:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494e00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.540333:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001766574a/0x119ccc6e683c3fe7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540340:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001766574a/0x119ccc6e683c3fe7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540347:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001766574a/0x119ccc6e683c3fe7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540353:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001766574a/0x119ccc6e683c3fe7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540372:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788643166.540375:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c3fee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540407:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.540410:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c3fee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540417:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c3fee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540426:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c3fee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540432:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c3fee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540444:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643166.540447:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c3ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540453:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495200 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.540456:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c3ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540474:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c3ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540483:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c3ff5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540489:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c3ff5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.540501:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.540503:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.540505:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.540513:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788643166.542104:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.542115:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c3ffc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.542129:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.542134:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.542139:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c3ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.542154:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c3ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.542164:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c3ffc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.542178:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c3ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.542202:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788643166.544101:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.544112:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4003 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.544131:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.544135:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.544140:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.544153:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.544164:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.544170:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.544189:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788643166.544600:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.544606:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac763b4/0x119ccc6e683c400a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.544613:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.544616:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.544619:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac763b4/0x119ccc6e683c400a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.544627:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac763b4/0x119ccc6e683c400a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.544644:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac763b4/0x119ccc6e683c400a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.544650:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac763b4/0x119ccc6e683c400a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.544784:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788643166.544790:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c3ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.544797:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3c800 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643166.544801:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c3ffc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.544809:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c3ffc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.544824:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c3ffc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.544832:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c3ffc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.544849:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788643166.544853:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.544870:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494800 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643166.544874:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.544881:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.544892:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4003 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.544898:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4003 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.544910:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.544912:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.544914:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.545225:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788643166.545486:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788643166.545491:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac763b4/0x119ccc6e683c400a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.545498:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495000 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643166.545501:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac763b4/0x119ccc6e683c400a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.545509:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac763b4/0x119ccc6e683c400a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.545527:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac763b4/0x119ccc6e683c400a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.545535:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac763b4/0x119ccc6e683c400a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.545552:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.545554:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.545555:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.545866:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788643166.545972:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.545979:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c4011 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.545989:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.545993:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.545997:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c4011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.546008:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c4011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.546016:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c4011 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.546023:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c4011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.546049:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788643166.546056:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643166.546060:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c4011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.546067:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494a00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.546070:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c4011 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788643166.547004:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788643166.547013:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000995547a2/0x119ccc6e683c4018 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.547035:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=647s v=(0 0) 00010000:00010000:1.0:1788643166.547038:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788643166.547043:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000995547a2/0x119ccc6e683c4018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.547057:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000995547a2/0x119ccc6e683c4018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.547067:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000995547a2/0x119ccc6e683c4018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.547219:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c4011 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.547234:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c4011 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.547242:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c4011 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.547259:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.547261:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.547263:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.547486:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000995547a2/0x119ccc6e683c4018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.547513:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788643166.548037:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788643166.548044:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c80d6e8d/0x119ccc6e683c401f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.548054:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=647s v=(0 0) 00010000:00010000:1.0:1788643166.548057:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788643166.548061:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c80d6e8d/0x119ccc6e683c401f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.548072:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c80d6e8d/0x119ccc6e683c401f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549230:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643166.549241:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000995547a2/0x119ccc6e683c4018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549251:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0031a00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.549261:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000995547a2/0x119ccc6e683c4018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549271:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000995547a2/0x119ccc6e683c4018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549288:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000995547a2/0x119ccc6e683c4018 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549294:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000995547a2/0x119ccc6e683c4018 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549313:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.549315:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.549316:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788643166.549377:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.549399:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c4026 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549408:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.549412:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.549417:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c4026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549426:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c4026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549435:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c4026 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549449:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c4026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549466:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788643166.549475:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643166.549479:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c4026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549486:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495200 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.549489:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c4026 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549497:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c4026 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549507:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c4026 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549514:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d07ab45f/0x119ccc6e683c4026 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.549527:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.549528:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.549530:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.549734:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c80d6e8d/0x119ccc6e683c401f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.549741:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c80d6e8d/0x119ccc6e683c401f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.549769:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788643166.550626:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.550634:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f61091/0x119ccc6e683c402d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.550644:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.550647:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.550651:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f61091/0x119ccc6e683c402d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.550672:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8f61091/0x119ccc6e683c402d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.550682:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8f61091/0x119ccc6e683c402d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.550689:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8f61091/0x119ccc6e683c402d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.550714:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788643166.551404:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.551412:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949f4b9d/0x119ccc6e683c4034 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.551422:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.551425:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.551429:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000949f4b9d/0x119ccc6e683c4034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.551438:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000949f4b9d/0x119ccc6e683c4034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.551446:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949f4b9d/0x119ccc6e683c4034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.551454:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000949f4b9d/0x119ccc6e683c4034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.551464:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788643166.551861:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788643166.551873:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c80d6e8d/0x119ccc6e683c401f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.551880:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0030a00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.551884:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c80d6e8d/0x119ccc6e683c401f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.551892:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c80d6e8d/0x119ccc6e683c401f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.551906:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c80d6e8d/0x119ccc6e683c401f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.551913:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c80d6e8d/0x119ccc6e683c401f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.551929:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788643166.551933:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8f61091/0x119ccc6e683c402d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.551939:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3d800 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.551942:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f61091/0x119ccc6e683c402d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.551950:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8f61091/0x119ccc6e683c402d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.551971:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8f61091/0x119ccc6e683c402d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.551977:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8f61091/0x119ccc6e683c402d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.551990:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643166.551994:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000949f4b9d/0x119ccc6e683c4034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.551999:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3cc00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.552002:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000949f4b9d/0x119ccc6e683c4034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.552009:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000949f4b9d/0x119ccc6e683c4034 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.552017:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000949f4b9d/0x119ccc6e683c4034 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.552023:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000949f4b9d/0x119ccc6e683c4034 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.552034:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.552035:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.552042:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.552048:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788643166.552225:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.552231:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fe269b1/0x119ccc6e683c403b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.552239:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.552248:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.552254:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fe269b1/0x119ccc6e683c403b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.552264:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fe269b1/0x119ccc6e683c403b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.552272:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fe269b1/0x119ccc6e683c403b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.552279:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fe269b1/0x119ccc6e683c403b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.552298:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788643166.553227:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643166.553235:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fe269b1/0x119ccc6e683c403b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.553245:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3c000 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.553248:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fe269b1/0x119ccc6e683c403b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.553256:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fe269b1/0x119ccc6e683c403b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.553270:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fe269b1/0x119ccc6e683c403b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.553277:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fe269b1/0x119ccc6e683c403b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.553293:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.553294:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.553295:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788643166.556340:0:25145:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00002000:00010000:3.0:1788643166.557590:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.557601:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1d860c/0x119ccc6e683c4042 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.557616:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.557621:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.557627:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1d860c/0x119ccc6e683c4042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.557640:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1d860c/0x119ccc6e683c4042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.557650:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1d860c/0x119ccc6e683c4042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.557663:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b1d860c/0x119ccc6e683c4042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.557686:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788643166.558292:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.558300:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5ce79f/0x119ccc6e683c4049 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.558310:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.558314:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.558318:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5ce79f/0x119ccc6e683c4049 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.558332:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5ce79f/0x119ccc6e683c4049 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.558339:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5ce79f/0x119ccc6e683c4049 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.558352:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5ce79f/0x119ccc6e683c4049 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.558376:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788643166.558833:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.558839:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000805d0a6c/0x119ccc6e683c4050 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.558847:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.558850:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.558854:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000805d0a6c/0x119ccc6e683c4050 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.558863:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000805d0a6c/0x119ccc6e683c4050 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.558871:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000805d0a6c/0x119ccc6e683c4050 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.558877:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000805d0a6c/0x119ccc6e683c4050 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.558885:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788643166.559225:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.559230:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3712deb/0x119ccc6e683c4057 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.559244:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.559247:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.559251:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3712deb/0x119ccc6e683c4057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.559261:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3712deb/0x119ccc6e683c4057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.559268:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3712deb/0x119ccc6e683c4057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.559275:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3712deb/0x119ccc6e683c4057 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.559284:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788643166.559452:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788643166.559459:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b1d860c/0x119ccc6e683c4042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559468:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3ce00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.559472:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1d860c/0x119ccc6e683c4042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559488:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1d860c/0x119ccc6e683c4042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559503:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b1d860c/0x119ccc6e683c4042 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559511:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1d860c/0x119ccc6e683c4042 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559530:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788643166.559534:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5ce79f/0x119ccc6e683c4049 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559540:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7aac00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.559543:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5ce79f/0x119ccc6e683c4049 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559550:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5ce79f/0x119ccc6e683c4049 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559560:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5ce79f/0x119ccc6e683c4049 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559567:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5ce79f/0x119ccc6e683c4049 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559591:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788643166.559594:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000805d0a6c/0x119ccc6e683c4050 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559600:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7aa600 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.559603:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000805d0a6c/0x119ccc6e683c4050 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559610:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000805d0a6c/0x119ccc6e683c4050 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559620:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000805d0a6c/0x119ccc6e683c4050 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559628:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000805d0a6c/0x119ccc6e683c4050 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559638:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643166.559641:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3712deb/0x119ccc6e683c4057 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559647:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7aa800 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.559651:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3712deb/0x119ccc6e683c4057 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559681:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3712deb/0x119ccc6e683c4057 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559692:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3712deb/0x119ccc6e683c4057 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559698:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3712deb/0x119ccc6e683c4057 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.559711:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.559713:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.559715:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.561007:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788643166.561131:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.561139:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0f19272/0x119ccc6e683c405e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.561153:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.561158:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.561163:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f19272/0x119ccc6e683c405e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.561176:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0f19272/0x119ccc6e683c405e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.561196:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0f19272/0x119ccc6e683c405e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.561203:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f19272/0x119ccc6e683c405e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.561225:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788643166.561477:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788643166.561483:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0f19272/0x119ccc6e683c405e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.561492:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7aba00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643166.561496:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f19272/0x119ccc6e683c405e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.561505:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f19272/0x119ccc6e683c405e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.561521:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0f19272/0x119ccc6e683c405e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.561528:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0f19272/0x119ccc6e683c405e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.561545:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.561547:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.561548:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788643166.563106:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.563118:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4065 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.563131:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.563134:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.563140:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.563151:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.563161:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.563169:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.563194:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788643166.563648:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.563655:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c406c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788643166.563816:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.563822:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c4073 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.563830:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.563833:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.563837:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c4073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.563858:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c4073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.563866:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c4073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.563873:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c4073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.563888:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788643166.563977:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788643166.563983:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.563992:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3c800 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643166.563996:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.564004:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4065 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.564018:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4065 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.564025:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4065 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.564051:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788643166.564055:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c4073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.564061:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3d400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643166.564064:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c4073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.564072:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c4073 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.564555:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c4073 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.564563:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c4073 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.564577:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.564579:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.564581:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.564808:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.564811:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.564815:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c406c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.564828:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c406c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.564838:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c406c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.564853:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c406c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.564870:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788643166.565253:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643166.565259:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c406c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.565267:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494a00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.565270:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c406c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.565279:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c406c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.565291:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c406c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.565298:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b04bd835/0x119ccc6e683c406c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.565315:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.565322:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.565324:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.565816:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788643166.565930:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.565937:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c407a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.565947:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.565950:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.565954:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c407a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.565964:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c407a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.565972:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c407a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.565978:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c407a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.565999:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788643166.566231:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.566236:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6624552/0x119ccc6e683c4081 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566244:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.566247:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.566250:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6624552/0x119ccc6e683c4081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566259:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6624552/0x119ccc6e683c4081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566266:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6624552/0x119ccc6e683c4081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566272:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6624552/0x119ccc6e683c4081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566286:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788643166.566399:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788643166.566405:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c407a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566411:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.566415:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c407a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566432:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c407a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566443:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c407a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566450:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4950a2c/0x119ccc6e683c407a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566464:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643166.566467:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6624552/0x119ccc6e683c4081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566473:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab600 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.566475:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6624552/0x119ccc6e683c4081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566482:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6624552/0x119ccc6e683c4081 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566490:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6624552/0x119ccc6e683c4081 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566496:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6624552/0x119ccc6e683c4081 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.566517:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.566519:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.566520:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.566570:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788643166.566974:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1788643166.566989:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788643166.566994:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788643166.567216:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23497:x1875527696897664:12345-0@lo:5:osp-pre-1-1.0 Request processed in 62716us (62777us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788643166.567227:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788643166.567274:0:23497:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788643166.567280:0:23497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23497:1875527696897664:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788643166.567294:0:23497:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788643166.567341:0:23497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa22d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23497:1875527696897792:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788643166.567400:0:23497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643166.567425:0:23497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc488d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788643166.567447:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696897792 00000100:00100000:0.0:1788643166.567453:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696897792 00000100:00100000:0.0:1788643166.567491:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788643166.567499:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23497:x1875527696897792:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788643166.567543:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23497:x1875527696897792:12345-0@lo:900:osp-pre-1-1.0 Request processed in 44us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643166.567550:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788643166.567582:0:23497:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cacefa22d80 x1875527696897792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788643182 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788643166.567608:0:23497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa22d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23497:1875527696897792:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1788643166.567917:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.567925:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8207b07/0x119ccc6e683c4088 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.567948:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.567951:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.567957:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8207b07/0x119ccc6e683c4088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.567969:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8207b07/0x119ccc6e683c4088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.567979:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8207b07/0x119ccc6e683c4088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.567987:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8207b07/0x119ccc6e683c4088 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.568009:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788643166.568454:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.568460:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efb0160e/0x119ccc6e683c408f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.568469:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.568472:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.568476:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efb0160e/0x119ccc6e683c408f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.568485:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efb0160e/0x119ccc6e683c408f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.568504:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efb0160e/0x119ccc6e683c408f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.568512:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efb0160e/0x119ccc6e683c408f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.568528:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000020:00000004:1.0:1788643166.568847:0:25145:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00002000:00010000:3.0:1788643166.569195:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.569203:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bba92e6/0x119ccc6e683c4096 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.569212:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.569215:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.569219:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bba92e6/0x119ccc6e683c4096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.569228:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bba92e6/0x119ccc6e683c4096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.569237:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bba92e6/0x119ccc6e683c4096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.569244:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bba92e6/0x119ccc6e683c4096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.569263:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788643166.569434:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788643166.569442:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8207b07/0x119ccc6e683c4088 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569456:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3de00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.569461:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8207b07/0x119ccc6e683c4088 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569471:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8207b07/0x119ccc6e683c4088 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569487:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8207b07/0x119ccc6e683c4088 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569494:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8207b07/0x119ccc6e683c4088 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569511:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788643166.569515:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efb0160e/0x119ccc6e683c408f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569521:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3ca00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.569524:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efb0160e/0x119ccc6e683c408f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569531:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efb0160e/0x119ccc6e683c408f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569539:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efb0160e/0x119ccc6e683c408f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569551:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efb0160e/0x119ccc6e683c408f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569562:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643166.569565:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bba92e6/0x119ccc6e683c4096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569570:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3da00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.569573:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bba92e6/0x119ccc6e683c4096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569581:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bba92e6/0x119ccc6e683c4096 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569590:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bba92e6/0x119ccc6e683c4096 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569598:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bba92e6/0x119ccc6e683c4096 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.569608:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.569609:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.569611:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.569842:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788643166.570278:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.570285:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c409d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.570295:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.570298:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.570303:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c409d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.570313:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c409d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.570321:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c409d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.570329:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c409d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.570341:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788643166.571157:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.571165:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e742d5/0x119ccc6e683c40a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.571175:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.571178:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.571183:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e742d5/0x119ccc6e683c40a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.571192:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e742d5/0x119ccc6e683c40a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.571201:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e742d5/0x119ccc6e683c40a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.571208:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e742d5/0x119ccc6e683c40a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.571227:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788643166.571992:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788643166.572001:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c409d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.572019:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3d600 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.572023:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c409d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.572032:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c409d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.572049:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c409d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.572055:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ded2d07/0x119ccc6e683c409d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.572087:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643166.572091:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e742d5/0x119ccc6e683c40a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.572097:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7aa400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.572100:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e742d5/0x119ccc6e683c40a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.572107:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e742d5/0x119ccc6e683c40a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.572116:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e742d5/0x119ccc6e683c40a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.572129:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e742d5/0x119ccc6e683c40a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.572143:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.572144:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.572146:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.572419:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788643166.573352:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.573361:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c40ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.573374:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.573416:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.573422:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c40ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.573434:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c40ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.573444:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c40ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.573451:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c40ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.573468:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788643166.573744:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.573760:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055f9bcee/0x119ccc6e683c40b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.573770:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.573778:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.573783:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055f9bcee/0x119ccc6e683c40b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.573792:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055f9bcee/0x119ccc6e683c40b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.573800:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055f9bcee/0x119ccc6e683c40b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.573807:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055f9bcee/0x119ccc6e683c40b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.573827:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788643166.574303:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788643166.574311:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c40ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.574319:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3d000 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.574323:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c40ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.574330:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c40ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.574344:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c40ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.574351:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9de75ce/0x119ccc6e683c40ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.574372:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643166.574375:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055f9bcee/0x119ccc6e683c40b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.574413:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e9400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643166.574417:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055f9bcee/0x119ccc6e683c40b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.574424:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055f9bcee/0x119ccc6e683c40b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.574434:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055f9bcee/0x119ccc6e683c40b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.574441:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055f9bcee/0x119ccc6e683c40b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.574455:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.574456:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643166.574457:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788643166.575028:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.575036:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfded07f/0x119ccc6e683c40b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.575045:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.575048:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.575053:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfded07f/0x119ccc6e683c40b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.575062:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfded07f/0x119ccc6e683c40b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.575070:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfded07f/0x119ccc6e683c40b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.577533:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788643166.577691:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788643166.577702:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6482966/0x119ccc6e683c40c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.577716:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=647s v=(0 0) 00010000:00010000:1.0:1788643166.577720:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788643166.577726:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6482966/0x119ccc6e683c40c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.577761:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6482966/0x119ccc6e683c40c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.577772:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6482966/0x119ccc6e683c40c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.577780:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6482966/0x119ccc6e683c40c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.577817:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788643166.578091:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfded07f/0x119ccc6e683c40b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.578111:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788643166.578855:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788643166.578863:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6482966/0x119ccc6e683c40c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.578873:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0031400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643166.578877:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6482966/0x119ccc6e683c40c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.578887:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6482966/0x119ccc6e683c40c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.578903:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6482966/0x119ccc6e683c40c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.578918:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6482966/0x119ccc6e683c40c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.578938:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788643166.578942:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfded07f/0x119ccc6e683c40b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.578948:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e9200 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643166.578951:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfded07f/0x119ccc6e683c40b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.578958:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfded07f/0x119ccc6e683c40b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.578967:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfded07f/0x119ccc6e683c40b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.578972:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfded07f/0x119ccc6e683c40b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.578985:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.578987:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.578988:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.579433:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788643166.579577:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.579584:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000445872aa/0x119ccc6e683c40c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.579595:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.579599:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.579605:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445872aa/0x119ccc6e683c40c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.579616:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000445872aa/0x119ccc6e683c40c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.579625:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000445872aa/0x119ccc6e683c40c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.579632:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000445872aa/0x119ccc6e683c40c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788643166.579796:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.579802:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c40ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.579817:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.579820:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.579824:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c40ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.579833:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c40ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.579841:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c40ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.579847:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c40ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.579859:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788643166.580040:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788643166.580046:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000445872aa/0x119ccc6e683c40c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.580054:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e9a00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643166.580057:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000445872aa/0x119ccc6e683c40c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.580064:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000445872aa/0x119ccc6e683c40c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.580089:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000445872aa/0x119ccc6e683c40c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.580098:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788643166.580101:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c40ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.580107:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3c400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643166.580110:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c40ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.580117:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c40ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.580135:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c40ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.580141:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023c6ee8b/0x119ccc6e683c40ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.580155:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.580157:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.580159:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.580165:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.580759:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788643166.580767:0:25142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000445872aa/0x119ccc6e683c40c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788643166.581482:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.581490:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002393fa7/0x119ccc6e683c40d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.581502:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.581506:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.581511:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002393fa7/0x119ccc6e683c40d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.581524:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002393fa7/0x119ccc6e683c40d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.581545:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002393fa7/0x119ccc6e683c40d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.581553:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002393fa7/0x119ccc6e683c40d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.581570:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788643166.581836:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.581841:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f2760e8/0x119ccc6e683c40dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.581850:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.581853:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.581857:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f2760e8/0x119ccc6e683c40dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.581866:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f2760e8/0x119ccc6e683c40dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.581873:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f2760e8/0x119ccc6e683c40dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.581879:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f2760e8/0x119ccc6e683c40dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.581893:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788643166.582252:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788643166.582258:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002393fa7/0x119ccc6e683c40d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.582267:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3d400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643166.582271:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002393fa7/0x119ccc6e683c40d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.582279:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002393fa7/0x119ccc6e683c40d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.582294:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002393fa7/0x119ccc6e683c40d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.582302:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002393fa7/0x119ccc6e683c40d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.582330:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788643166.582334:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f2760e8/0x119ccc6e683c40dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.582340:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e8c00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643166.582343:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f2760e8/0x119ccc6e683c40dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.582350:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f2760e8/0x119ccc6e683c40dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.582360:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f2760e8/0x119ccc6e683c40dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.582368:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f2760e8/0x119ccc6e683c40dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.582402:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.582404:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.582405:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.582411:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788643166.582586:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.582592:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c40e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.582600:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.582603:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.582613:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c40e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.582622:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c40e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.582629:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c40e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.582635:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c40e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.582994:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788643166.582999:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c40e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.583007:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e9c00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643166.583017:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c40e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.583025:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c40e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.583036:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c40e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.583044:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.583045:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.583046:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.583271:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788643166.583277:0:25142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c40e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788643166.583943:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.583950:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c40ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.583960:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.583964:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.583968:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c40ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.583977:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c40ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.583986:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c40ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.583993:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c40ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.584027:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788643166.584494:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643166.584500:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c40ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.584508:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3c800 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.584512:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c40ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.584521:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c40ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.584547:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c40ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.584554:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076be6b1a/0x119ccc6e683c40ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.584569:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.584570:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.584572:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788643166.584710:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788643166.584716:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b2fd23/0x119ccc6e683c40f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.584725:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=647s v=(0 0) 00010000:00010000:1.0:1788643166.584728:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788643166.584743:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b2fd23/0x119ccc6e683c40f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.584761:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b2fd23/0x119ccc6e683c40f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.584769:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b2fd23/0x119ccc6e683c40f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.584775:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b2fd23/0x119ccc6e683c40f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.584802:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788643166.585264:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643166.585270:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7b2fd23/0x119ccc6e683c40f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.585278:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0031200 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.585281:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b2fd23/0x119ccc6e683c40f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.585288:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b2fd23/0x119ccc6e683c40f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.585301:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7b2fd23/0x119ccc6e683c40f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.585308:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b2fd23/0x119ccc6e683c40f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.585335:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.585337:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.585339:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788643166.586186:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788643166.586195:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066330522/0x119ccc6e683c40f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.586207:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=647s v=(0 0) 00010000:00010000:1.0:1788643166.586211:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788643166.586215:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066330522/0x119ccc6e683c40f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.586225:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066330522/0x119ccc6e683c40f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.586234:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066330522/0x119ccc6e683c40f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.586240:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066330522/0x119ccc6e683c40f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.586263:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788643166.586562:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.586569:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000899407a/0x119ccc6e683c40ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.586577:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.586580:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.586584:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000899407a/0x119ccc6e683c40ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.586593:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000899407a/0x119ccc6e683c40ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.586601:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000899407a/0x119ccc6e683c40ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.586608:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000899407a/0x119ccc6e683c40ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.586626:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788643166.587813:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788643166.587822:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066330522/0x119ccc6e683c40f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.587833:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0030600 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643166.587844:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066330522/0x119ccc6e683c40f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.587855:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066330522/0x119ccc6e683c40f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.587872:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066330522/0x119ccc6e683c40f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.587880:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066330522/0x119ccc6e683c40f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.587898:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788643166.587901:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000899407a/0x119ccc6e683c40ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.587907:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e9000 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643166.587910:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000899407a/0x119ccc6e683c40ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.587916:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000899407a/0x119ccc6e683c40ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.587925:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000899407a/0x119ccc6e683c40ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.587931:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000899407a/0x119ccc6e683c40ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.587952:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.587953:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.587955:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788643166.588268:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.588275:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046e5e623/0x119ccc6e683c4106 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.588294:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.588297:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.588302:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046e5e623/0x119ccc6e683c4106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.588311:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046e5e623/0x119ccc6e683c4106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.588318:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046e5e623/0x119ccc6e683c4106 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.588325:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046e5e623/0x119ccc6e683c4106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.588338:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788643166.588668:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788643166.588674:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046e5e623/0x119ccc6e683c4106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.588681:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e8600 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643166.588685:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046e5e623/0x119ccc6e683c4106 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.588692:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046e5e623/0x119ccc6e683c4106 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.588704:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046e5e623/0x119ccc6e683c4106 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.588711:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046e5e623/0x119ccc6e683c4106 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.588725:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.588726:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.588732:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788643166.590233:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.590243:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000445872aa/0x119ccc6e683c410d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.590255:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.590259:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.590264:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000445872aa/0x119ccc6e683c410d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.590276:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000445872aa/0x119ccc6e683c410d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.590296:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000445872aa/0x119ccc6e683c410d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.590302:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000445872aa/0x119ccc6e683c410d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.590319:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788643166.590543:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788643166.590550:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000445872aa/0x119ccc6e683c410d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.590568:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e9a00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643166.590573:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000445872aa/0x119ccc6e683c410d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.590581:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000445872aa/0x119ccc6e683c410d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.590596:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000445872aa/0x119ccc6e683c410d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.590603:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000445872aa/0x119ccc6e683c410d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.590619:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.590621:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.590623:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.591198:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788643166.591415:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.591423:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087a1b1b2/0x119ccc6e683c4114 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.591434:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.591437:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.591441:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087a1b1b2/0x119ccc6e683c4114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.591452:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087a1b1b2/0x119ccc6e683c4114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.591461:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087a1b1b2/0x119ccc6e683c4114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.591468:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087a1b1b2/0x119ccc6e683c4114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.591493:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788643166.595302:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788643166.595314:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087a1b1b2/0x119ccc6e683c4114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.595327:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e8000 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643166.595332:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087a1b1b2/0x119ccc6e683c4114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.595343:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087a1b1b2/0x119ccc6e683c4114 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.595376:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087a1b1b2/0x119ccc6e683c4114 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.595414:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087a1b1b2/0x119ccc6e683c4114 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.595436:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.595438:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.595440:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788643166.598150:0:24261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788643166.598161:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7b2fd23/0x119ccc6e683c411b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.598175:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=647s v=(0 0) 00010000:00010000:1.0:1788643166.598180:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788643166.598188:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b2fd23/0x119ccc6e683c411b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.598202:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7b2fd23/0x119ccc6e683c411b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.598212:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7b2fd23/0x119ccc6e683c411b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.598220:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b2fd23/0x119ccc6e683c411b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.598246:0:24261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788643166.598579:0:24261:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1788643166.598668:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22777:x1875527696896896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 112659us (113813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643166.598678:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788643166.598728:0:22777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22777:1875527696896896:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788643166.598743:0:22777:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788643166.598793:0:22777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22777:1875527696897920:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788643166.598828:0:22777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643166.598852:0:22777:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc6a25900 going to sleep for 11 seconds 00000100:00100000:1.0:1788643166.598872:0:24706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696897920 00000100:00100000:1.0:1788643166.598878:0:24706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696897920 00000100:00100000:1.0:1788643166.598912:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788643166.598919:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22777:x1875527696897920:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788643166.598952:0:24706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:0.0:1788643166.601300:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643166.601312:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7b2fd23/0x119ccc6e683c411b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.601324:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0031200 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.601329:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b2fd23/0x119ccc6e683c411b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.601338:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b2fd23/0x119ccc6e683c411b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.601357:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7b2fd23/0x119ccc6e683c411b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.601365:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b2fd23/0x119ccc6e683c411b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.601411:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.601413:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.601414:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788643166.604245:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.604261:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf897ee/0x119ccc6e683c4122 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.604278:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.604281:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.604288:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf897ee/0x119ccc6e683c4122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.604301:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbf897ee/0x119ccc6e683c4122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.604322:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbf897ee/0x119ccc6e683c4122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.604329:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbf897ee/0x119ccc6e683c4122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.604360:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788643166.607270:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643166.607284:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbf897ee/0x119ccc6e683c4122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.607298:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494c00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.607312:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf897ee/0x119ccc6e683c4122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.607323:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbf897ee/0x119ccc6e683c4122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.607343:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbf897ee/0x119ccc6e683c4122 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.607350:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbf897ee/0x119ccc6e683c4122 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.607374:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.607375:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.607377:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788643166.617578:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.617590:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c4129 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.617607:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.617611:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.617618:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c4129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.617632:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c4129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.617641:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c4129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.617656:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c4129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.617681:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788643166.617907:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788643166.617915:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c4129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.617924:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e9c00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643166.617928:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c4129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.617938:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c4129 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.617956:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c4129 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.617964:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000135f5c88/0x119ccc6e683c4129 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.617982:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.617984:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.617986:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788643166.620232:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.620245:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041b91498/0x119ccc6e683c4130 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.620260:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.620264:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.620270:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041b91498/0x119ccc6e683c4130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.620295:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041b91498/0x119ccc6e683c4130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.620305:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041b91498/0x119ccc6e683c4130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.620312:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041b91498/0x119ccc6e683c4130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.620336:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788643166.621109:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788643166.621117:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041b91498/0x119ccc6e683c4130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.621127:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e9600 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643166.621132:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041b91498/0x119ccc6e683c4130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.621145:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041b91498/0x119ccc6e683c4130 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.621169:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041b91498/0x119ccc6e683c4130 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.621176:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041b91498/0x119ccc6e683c4130 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.621192:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.621194:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643166.621196:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788643166.621914:0:24255:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1788643166.621959:0:24255:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788643166.622441:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788643166.622450:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4b5043b/0x119ccc6e683c4137 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.622464:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=647s v=(0 0) 00010000:00010000:2.0:1788643166.622468:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643166.622473:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b5043b/0x119ccc6e683c4137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.622484:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4b5043b/0x119ccc6e683c4137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.622493:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4b5043b/0x119ccc6e683c4137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.622501:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4b5043b/0x119ccc6e683c4137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643166.622534:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788643166.623052:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643166.623060:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4b5043b/0x119ccc6e683c4137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.623086:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.623090:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b5043b/0x119ccc6e683c4137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.623099:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4b5043b/0x119ccc6e683c4137 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.623114:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4b5043b/0x119ccc6e683c4137 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.623122:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4b5043b/0x119ccc6e683c4137 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.623138:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.623140:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.623141:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643166.626401:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22777:x1875527696897920:12345-0@lo:5:osp-pre-0-0.0 Request processed in 27458us (27549us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788643166.626416:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00010000:0.0:1788643166.626613:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788643166.626622:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f94316/0x119ccc6e683c413e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.626636:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1788643166.626641:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643166.626647:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f94316/0x119ccc6e683c413e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.626660:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0f94316/0x119ccc6e683c413e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.626677:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f94316/0x119ccc6e683c413e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.626685:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f94316/0x119ccc6e683c413e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.626713:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788643166.630246:0:22777:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1788643166.630261:0:22777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22777:1875527696897920:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788643166.630278:0:22777:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1788643166.630680:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788643166.630689:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0f94316/0x119ccc6e683c413e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.630701:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e8a00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643166.630706:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f94316/0x119ccc6e683c413e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.630717:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f94316/0x119ccc6e683c413e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.630746:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0f94316/0x119ccc6e683c413e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.630762:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0f94316/0x119ccc6e683c413e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.630782:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.630784:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643166.630786:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788643166.631070:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788643166.631089:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066330522/0x119ccc6e683c4145 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.631099:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=647s v=(0 0) 00010000:00010000:1.0:1788643166.631103:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788643166.631109:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066330522/0x119ccc6e683c4145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.631121:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066330522/0x119ccc6e683c4145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.631145:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066330522/0x119ccc6e683c4145 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.631152:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066330522/0x119ccc6e683c4145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643166.631175:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788643166.631343:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643166.631349:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066330522/0x119ccc6e683c4145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.631356:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc0030600 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.631360:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066330522/0x119ccc6e683c4145 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.631368:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066330522/0x119ccc6e683c4145 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.631401:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066330522/0x119ccc6e683c4145 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.631409:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066330522/0x119ccc6e683c4145 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.631424:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.631432:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.631434:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788643166.631994:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.632002:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d77351d5/0x119ccc6e683c414c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.632011:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.632015:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.632019:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d77351d5/0x119ccc6e683c414c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.632040:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d77351d5/0x119ccc6e683c414c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.632049:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d77351d5/0x119ccc6e683c414c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.632055:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d77351d5/0x119ccc6e683c414c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.632084:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788643166.632533:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.632540:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4153 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.632548:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.632551:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.632555:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.632564:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.632572:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4153 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.632593:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.632611:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788643166.632864:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788643166.632871:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d77351d5/0x119ccc6e683c414c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.632879:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3c600 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.632883:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d77351d5/0x119ccc6e683c414c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.632892:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d77351d5/0x119ccc6e683c414c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.632905:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d77351d5/0x119ccc6e683c414c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.632912:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d77351d5/0x119ccc6e683c414c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.632928:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643166.632931:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.632937:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3c800 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.632940:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4153 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.632959:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4153 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.632971:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4153 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.632977:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076be6b1a/0x119ccc6e683c4153 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.632989:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.632991:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.632992:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788643166.633070:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788643166.633086:0:25142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c415a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.633094:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=647s v=(0 0) 00010000:00010000:3.0:1788643166.633097:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788643166.633100:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c415a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.633108:0:25142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c415a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.633114:0:25142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c415a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.633120:0:25142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c415a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643166.633139:0:25142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788643166.633171:0:25142:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1788643166.633254:0:25142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22779:x1875527696897408:12345-0@lo:5:osp-pre-1-0.0 Request processed in 131944us (147421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643166.633268:0:25142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788643166.633414:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788643166.633418:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c415a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.633426:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3d400 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:0.0:1788643166.633429:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c415a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.633437:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c415a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.633448:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c415a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.633467:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002393fa7/0x119ccc6e683c415a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643166.633479:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.633481:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643166.633482:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643166.633568:0:22779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22779:1875527696897408:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788643166.633583:0:22779:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1788643166.633624:0:22779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22779:1875527696898048:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788643166.633656:0:22779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643166.633713:0:22779:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacfd73a0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788643166.633784:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643166.642459:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696898048 00000100:00100000:0.0:1788643166.642474:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696898048 00000100:00100000:0.0:1788643166.642538:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788643166.642800:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22779:x1875527696898048:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788643166.642893:0:24260:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1788643166.661921:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22779:x1875527696898048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 19368us (28257us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788643166.661936:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788643166.661990:0:22779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22779:1875527696898048:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788643166.662004:0:22779:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 10000000:01000000:1.0:1788643167.243681:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788643167.243688:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cabc783a000 from 14 10000000:01000000:1.0:1788643167.243693:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788643167.243755:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031a00/0x119ccc6e683c4161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643167.243767:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc0031a00/0x119ccc6e683c4161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643167.243779:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc0031a00/0x119ccc6e683c4161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643167.243803:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696898176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788643167.243870:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643167.243947:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc6a25600 going to sleep for 11 seconds 00000100:00100000:3.0:1788643167.244899:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696898176 00000100:00100000:3.0:1788643167.244909:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696898176 00000100:00100000:3.0:1788643167.245005:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788643167.245016:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+22:22749:x1875527696898176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643167.245029:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643167.245043:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacf6d3c400/0x119ccc6e683c4168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c4161 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643167.245067:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacf6d3c400/0x119ccc6e683c4168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c4161 expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643167.245077:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacf6d3c400/0x119ccc6e683c4168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c4161 expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643167.245085:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacf6d3c400, rc 0) 00000100:00100000:3.0:1788643167.245147:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+23:22749:x1875527696898176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643167.245153:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788643167.245225:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696898176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788643167.245241:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc0031a00/0x119ccc6e683c4161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4168 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643167.245265:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc0031a00/0x119ccc6e683c4161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c4168 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643167.245313:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696898304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788643167.245343:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643167.251421:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc6a25600 going to sleep for 11 seconds 00000100:00100000:2.0:1788643167.256027:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696898304 00000100:00100000:2.0:1788643167.256041:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696898304 00000100:00100000:2.0:1788643167.256269:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788643167.256280:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+23:22749:x1875527696898304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788643167.256305:0:22746:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788643167.256327:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788643167.256330:0:22746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788643167.256584:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+23:22749:x1875527696898304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 305us (11238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643167.256592:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788643167.256777:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696898304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788643167.256835:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788643167.256843:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0031a00/0x119ccc6e683c4161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4168 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643167.256853:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc0031a00/0x119ccc6e683c4161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4168 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788643167.256861:0:22749:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788643167.256863:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cabc94a4800 from 14 10000000:01000000:1.0:1788643167.256866:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788643167.256891:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0030a00/0x119ccc6e683c416f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643167.256899:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacc0030a00/0x119ccc6e683c416f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643167.256907:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacc0030a00/0x119ccc6e683c416f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643167.256922:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696898432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788643167.256958:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643167.256988:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc6a25600 going to sleep for 11 seconds 00000100:00100000:2.0:1788643167.257100:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696898432 00000100:00100000:2.0:1788643167.257106:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696898432 00000100:00100000:2.0:1788643167.257127:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788643167.257133:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+23:22749:x1875527696898432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788643167.257143:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643167.257155:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cabc7495600/0x119ccc6e683c4176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c416f expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643167.257174:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cabc7495600/0x119ccc6e683c4176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c416f expref: 24 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643167.257194:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cabc7495600/0x119ccc6e683c4176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c416f expref: 24 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643167.257202:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7495600, rc 0) 00000100:00100000:2.0:1788643167.257239:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+24:22749:x1875527696898432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643167.257252:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788643167.257696:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696898432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788643167.257709:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacc0030a00/0x119ccc6e683c416f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4176 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643167.257718:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacc0030a00/0x119ccc6e683c416f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c4176 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643167.260068:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696898560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788643167.260139:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643167.260184:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc6a25600 going to sleep for 11 seconds 00000100:00100000:2.0:1788643167.260251:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696898560 00000100:00100000:2.0:1788643167.260259:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696898560 00000100:00100000:2.0:1788643167.260305:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788643167.260314:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+24:22749:x1875527696898560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788643167.260332:0:22746:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788643167.260348:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788643167.260351:0:22746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788643167.260471:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+24:22749:x1875527696898560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643167.260480:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788643167.260631:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696898560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788643167.260698:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788643167.260706:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacc0030a00/0x119ccc6e683c416f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4176 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643167.260717:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacc0030a00/0x119ccc6e683c416f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4176 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643167.377339:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643167.947806:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788643167.947828:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696898688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788643167.947892:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643167.948069:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696898688 00000100:00100000:3.0:1788643167.948077:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696898688 00000100:00100000:3.0:1788643167.948153:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788643167.948163:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696898688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788643167.948190:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788643167.948297:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696898688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643167.948304:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788643167.948394:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788643167.950156:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696898688:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788643168.399075:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643168.972877:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788643168.972896:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacefa22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696898816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788643168.972954:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643168.972994:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696898816 00000100:00100000:1.0:1788643168.973002:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696898816 00000100:00100000:1.0:1788643168.973048:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788643168.973291:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788643168.973347:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696898816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788643168.973377:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788643168.973449:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696898816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643168.973456:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788643168.973573:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacefa22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696898816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788643168.973895:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696898944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788643168.973926:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643168.974009:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696898944 00000100:00100000:0.0:1788643168.974014:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696898944 00000100:00100000:0.0:1788643168.974082:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788643168.974090:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696898944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788643168.974117:0:22757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788643168.974159:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696898944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643168.974165:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788643168.974220:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696898944:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788643169.419763:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788643170.454047:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643171.467741:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643171.532508:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696899072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788643171.532572:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.532632:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696899584:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.532655:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.532674:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696900096:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.532694:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.532708:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875527696900608:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.532742:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.532765:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788643171.532770:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696899456:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.532790:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.532804:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696899968:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.532823:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.532835:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875527696900480:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.532856:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.532884:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696899200:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.532912:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643171.533176:0:24706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696899584 00000100:00100000:3.0:1788643171.533183:0:24706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696899584 00000100:00100000:3.0:1788643171.533228:0:24706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696900096 00000100:00100000:3.0:1788643171.533232:0:24706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696900096 00000100:00100000:3.0:1788643171.533243:0:24706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696899456 00000100:00100000:3.0:1788643171.533245:0:24706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696899456 00000100:00100000:3.0:1788643171.533254:0:24706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696899968 00000100:00100000:3.0:1788643171.533256:0:24706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696899968 00000100:00100000:3.0:1788643171.533268:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788643171.533275:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875527696899584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643171.533323:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875527696899584:12345-0@lo:400:kworker.0 Request processed in 47us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643171.533330:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788643171.533345:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788643171.533350:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696900096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643171.533375:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696900096:12345-0@lo:400:kworker.0 Request processed in 25us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643171.533397:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788643171.533408:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788643171.533414:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696899456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643171.533455:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696899456:12345-0@lo:400:kworker.0 Request processed in 42us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643171.533462:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788643171.533473:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788643171.533479:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696899968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643171.533504:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696899968:12345-0@lo:400:kworker.0 Request processed in 26us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643171.533509:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788643171.533530:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788643171.533533:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788643171.535334:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875527696899712:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.535409:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.540736:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875527696900224:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.540800:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.540822:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875527696900736:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.540848:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.540869:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788643171.540875:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696899328:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.540898:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.540921:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696899840:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.540939:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.540956:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875527696900352:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.540975:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.540985:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696900864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788643171.541004:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.541043:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696899072 00000100:00100000:1.0:1788643171.541050:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696899072 00000100:00100000:1.0:1788643171.541082:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696900864 00000100:00100000:1.0:1788643171.541085:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696900864 00000100:00100000:1.0:1788643171.541101:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788643171.541108:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875527696899072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788643171.541135:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788643171.541170:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875527696899072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (8598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.541177:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788643171.541191:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788643171.541196:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696900864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788643171.541210:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788643171.541234:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696900864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.541240:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788643171.541255:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696900608 00000100:00100000:1.0:1788643171.541258:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696900608 00000100:00100000:1.0:1788643171.541280:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696900480 00000100:00100000:1.0:1788643171.541283:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696900480 00000100:00100000:1.0:1788643171.541292:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696899712 00000100:00100000:1.0:1788643171.541294:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696899712 00000100:00100000:1.0:1788643171.541302:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696900224 00000100:00100000:1.0:1788643171.541304:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696900224 00000100:00100000:1.0:1788643171.541312:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696900736 00000100:00100000:1.0:1788643171.541313:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696900736 00000100:00100000:1.0:1788643171.541322:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696900352 00000100:00100000:1.0:1788643171.541324:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696900352 00000100:00100000:1.0:1788643171.541334:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788643171.541339:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875527696900608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.541364:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875527696900608:12345-0@lo:400:kworker.0 Request processed in 25us (8622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.541369:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788643171.541394:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788643171.541400:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875527696900480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.541422:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875527696900480:12345-0@lo:400:kworker.0 Request processed in 24us (8566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.541427:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788643171.541437:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788643171.541441:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875527696899712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.541470:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875527696899712:12345-0@lo:400:kworker.0 Request processed in 28us (6062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.541475:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788643171.541484:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788643171.541488:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875527696900224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.541506:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875527696900224:12345-0@lo:400:kworker.0 Request processed in 17us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.541510:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788643171.541518:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788643171.541523:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875527696900736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.541540:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875527696900736:12345-0@lo:400:kworker.0 Request processed in 18us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.541545:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788643171.541553:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788643171.541557:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875527696900352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.541575:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875527696900352:12345-0@lo:400:kworker.0 Request processed in 18us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.541580:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788643171.542759:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696899200 00000100:00100000:1.0:1788643171.542767:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696899200 00000100:00100000:1.0:1788643171.542804:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788643171.542810:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+24:3644:x1875527696899200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.542851:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+24:3644:x1875527696899200:12345-0@lo:400:kworker.0 Request processed in 41us (9938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.542857:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788643171.542889:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696899328 00000100:00100000:1.0:1788643171.542892:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696899328 00000100:00100000:1.0:1788643171.542910:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696899840 00000100:00100000:1.0:1788643171.542913:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696899840 00000100:00100000:1.0:1788643171.542923:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788643171.542928:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696899328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.542953:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696899328:12345-0@lo:400:kworker.0 Request processed in 26us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.542958:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788643171.542967:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788643171.542972:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696899840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.542990:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696899840:12345-0@lo:400:kworker.0 Request processed in 18us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.542995:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788643171.543014:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788643171.543017:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788643171.543065:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696899456:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.543075:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696899968:0@lo:400:kworker.0 00010000:00080000:1.0:1788643171.543087:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7ddb800 x1875527696900480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643171.543096:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875527696900480:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.543112:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696899072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788643171.543120:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696899584:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.543128:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696900096:0@lo:400:kworker.0 00010000:00080000:1.0:1788643171.543146:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7dd9500 x1875527696900608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643171.543154:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875527696900608:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.543176:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788643171.543183:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696900992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788643171.543206:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643171.543230:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696900992 00000100:00100000:1.0:1788643171.543233:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696900992 00000100:00100000:1.0:1788643171.543250:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788643171.543255:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696900992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788643171.543271:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788643171.543296:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696900992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643171.543302:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788643171.543323:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696899328:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.543332:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696899840:0@lo:400:kworker.0 00010000:00080000:1.0:1788643171.543341:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7dd8700 x1875527696900352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643171.543349:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875527696900352:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.543360:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696900864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788643171.543367:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696899200:0@lo:400:kworker.0 00010000:00080000:1.0:1788643171.543375:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7ddb100 x1875527696899712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643171.543408:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875527696899712:0@lo:400:kworker.0 00010000:00080000:1.0:1788643171.543420:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7ddad80 x1875527696900224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643171.543427:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875527696900224:0@lo:400:kworker.0 00010000:00080000:1.0:1788643171.543436:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7ddaa00 x1875527696900736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643171.543443:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875527696900736:0@lo:400:kworker.0 00000100:00100000:1.0:1788643171.543476:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696900992:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788643172.331868:0:25435:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg618-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788643172.493128:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788643172.562903:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:0.0:1788643173.068996:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788643173.079027:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696901120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788643173.079095:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643173.081448:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696901120 00000100:00100000:1.0:1788643173.081460:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696901120 00000100:00100000:1.0:1788643173.081573:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788643173.081584:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacefa22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696901120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788643173.081612:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788643173.081685:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacefa22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696901120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643173.081692:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788643173.081765:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696901120:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788643173.081921:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:1.0:1788643173.090125:0:25487:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788643173.090334:0:25487:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788643173.517120:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788643173.791122:0:25537:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788643173.791519:0:25537:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788643173.839613:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788643173.963240:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643173.963345:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675821056 00000100:00100000:0.0:1788643173.963355:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675821056 00000100:00100000:0.0:1788643173.963457:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 115 00000100:00100000:0.0:1788643173.963465:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1875527675821056:12345-192.168.206.18@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788643173.963491:0:22746:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ce054bfd-e561-4af2-9937-f1d807468f29@192.168.206.18@tcp t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:0.0:1788643173.963519:0:22746:0:(genops.c:1385:class_connect()) connect: client ce054bfd-e561-4af2-9937-f1d807468f29, cookie 0x119ccc6e683c417d 00000100:00080000:0.0:1788643173.963644:0:22746:0:(import.c:65:import_set_state_nolock()) ffff9cacc54b5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788643173.963723:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+5:2398:x1875527675821056:12345-192.168.206.18@tcp:250:mount.lustre.0 Request processed in 257us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643173.963731:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 115 00000100:00100000:2.0:1788643173.974837:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643173.974935:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675821184 00000100:00100000:1.0:1788643173.974992:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675821184 00000100:00100000:1.0:1788643173.975047:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 116 00000100:00100000:1.0:1788643173.975069:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+5:18076:x1875527675821184:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788643173.975083:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788643173.975099:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacc0031400/0x119ccc6e683c4184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c86f expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643173.975125:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc0031400/0x119ccc6e683c4184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c86f expref: 6 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643173.975136:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacc0031400/0x119ccc6e683c4184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c86f expref: 6 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643173.975144:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacc0031400, rc 0) 00000100:00100000:1.0:1788643173.975196:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+6:18076:x1875527675821184:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 129us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643173.975203:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 116 00000100:00100000:3.0:1788643173.976923:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643173.977017:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675821312 00000100:00100000:1.0:1788643173.977024:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675821312 00000100:00100000:1.0:1788643173.977084:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 117 00000100:00100000:1.0:1788643173.977093:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+6:18076:x1875527675821312:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788643173.977192:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+6:18076:x1875527675821312:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 100us (277us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788643173.977199:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 117 00000100:00100000:2.0:1788643173.979494:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643173.979591:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675821440 00000100:00100000:0.0:1788643173.979599:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675821440 00000100:00100000:0.0:1788643173.979688:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 118 00000100:00100000:0.0:1788643173.979707:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+6:18076:x1875527675821440:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788643173.979747:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643173.979764:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacff5e8c00/0x119ccc6e683c418b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c876 expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643173.979789:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacff5e8c00/0x119ccc6e683c418b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c876 expref: 7 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643173.979912:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacff5e8c00/0x119ccc6e683c418b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c876 expref: 7 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643173.979921:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacff5e8c00, rc 0) 00000100:00100000:0.0:1788643173.979973:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+7:18076:x1875527675821440:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 267us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643173.979980:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 118 00000100:00100000:2.0:1788643173.983949:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643173.984005:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675821568 00000100:00100000:1.0:1788643173.984019:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675821568 00000100:00100000:1.0:1788643173.984072:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 119 00000100:00100000:1.0:1788643173.984082:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+7:18076:x1875527675821568:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788643173.984220:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+8:18076:x1875527675821568:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 140us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643173.984243:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 119 00000100:00100000:3.0:1788643173.988608:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643173.988668:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675821696 00000100:00100000:1.0:1788643173.988678:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675821696 00000100:00100000:1.0:1788643173.988740:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 120 00000100:00100000:1.0:1788643173.988748:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+8:18076:x1875527675821696:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788643173.989049:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+8:18076:x1875527675821696:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 302us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643173.989055:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 120 00000100:00100000:2.0:1788643173.992726:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643173.992824:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675821824 00000100:00100000:0.0:1788643173.992833:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675821824 00000100:00100000:0.0:1788643173.992885:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 121 00000100:00100000:0.0:1788643173.992894:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+8:18095:x1875527675821824:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788643173.993043:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+8:18095:x1875527675821824:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 149us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643173.993051:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 121 00000100:00100000:2.0:1788643174.024784:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643174.026455:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675821952 00000100:00100000:1.0:1788643174.026470:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675821952 00000100:00100000:1.0:1788643174.026541:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 122 00000100:00100000:1.0:1788643174.026551:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+8:18095:x1875527675821952:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788643174.026761:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+8:18095:x1875527675821952:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 211us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643174.026769:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 122 00000100:00100000:1.0:1788643174.041332:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643174.041719:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675822080 00000100:00100000:3.0:1788643174.041892:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675822080 00000100:00100000:3.0:1788643174.042017:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 123 00000100:00100000:3.0:1788643174.042028:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+8:18095:x1875527675822080:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788643174.042455:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+8:18095:x1875527675822080:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 428us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643174.042464:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 123 00000100:00100000:2.0:1788643174.051739:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643174.051911:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675822208 00000100:00100000:1.0:1788643174.051920:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675822208 00000100:00100000:1.0:1788643174.051973:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:1.0:1788643174.051983:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+8:18076:x1875527675822208:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788643174.052000:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788643174.052014:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c4192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c8a7 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643174.052053:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c4192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8a7 expref: 9 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643174.052078:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacc0031200/0x119ccc6e683c4192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8a7 expref: 9 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643174.052088:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacc0031200, rc 0) 00000100:00100000:1.0:1788643174.052144:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+9:18076:x1875527675822208:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 163us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643174.052151:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 124 00000100:00100000:2.0:1788643174.055452:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643174.055915:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675822336 00000100:00100000:3.0:1788643174.055924:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675822336 00000100:00100000:3.0:1788643174.055975:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 125 00000100:00100000:3.0:1788643174.055985:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+9:18076:x1875527675822336:12345-192.168.206.18@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788643174.056008:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788643174.056035:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788643174.056040:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788643174.056043:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788643174.056046:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788643174.056049:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788643174.058817:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+9:18076:x1875527675822336:12345-192.168.206.18@tcp:256:mount.lustre.0 Request processed in 2824us (3364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643174.058830:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 125 00000100:00100000:2.0:1788643174.065789:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643174.075472:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675822464 00000100:00100000:0.0:1788643174.075487:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675822464 00000100:00100000:0.0:1788643174.075542:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 126 00000100:00100000:0.0:1788643174.075552:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+9:18076:x1875527675822464:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788643174.075566:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643174.075595:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacff5e9400/0x119ccc6e683c4199 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c8ae expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643174.075620:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacff5e9400/0x119ccc6e683c4199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8ae expref: 10 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643174.075631:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacff5e9400/0x119ccc6e683c4199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8ae expref: 10 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643174.075640:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacff5e9400, rc 0) 00000100:00100000:0.0:1788643174.077166:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+10:18076:x1875527675822464:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 1606us (11375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643174.077177:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 126 00000100:00100000:3.0:1788643174.084827:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643174.084904:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675822592 00000100:00100000:1.0:1788643174.084913:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675822592 00000100:00100000:1.0:1788643174.084963:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 127 00000100:00100000:1.0:1788643174.084972:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf63b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+10:18076:x1875527675822592:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788643174.096631:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788643174.096655:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696901248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788643174.096732:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643174.096786:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696901248 00000100:00100000:0.0:1788643174.096793:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696901248 00000100:00100000:0.0:1788643174.096838:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788643174.096845:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696901248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788643174.096878:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788643174.096920:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696901248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643174.096927:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788643174.096973:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696901248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788643174.097412:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf63b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+10:18076:x1875527675822592:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 12437us (12590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643174.097422:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 127 00000100:00100000:1.0:1788643174.097675:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788643174.097684:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc978f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696901376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788643174.097722:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643174.097758:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696901376 00000100:00100000:1.0:1788643174.097763:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696901376 00000100:00100000:1.0:1788643174.097790:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788643174.097797:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696901376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788643174.097816:0:22757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788643174.097866:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696901376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643174.097871:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788643174.097898:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc978f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696901376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788643174.099925:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643174.100018:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675822720 00000100:00100000:2.0:1788643174.100025:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675822720 00000100:00100000:2.0:1788643174.100092:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 128 00000100:00100000:2.0:1788643174.100101:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+10:18076:x1875527675822720:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788643174.100219:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+10:18076:x1875527675822720:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 119us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643174.100226:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 128 00000100:00100000:2.0:1788643174.108699:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643174.109306:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675822848 00000100:00100000:1.0:1788643174.109315:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675822848 00000100:00100000:1.0:1788643174.109369:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 129 00000100:00100000:1.0:1788643174.109412:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+10:18099:x1875527675822848:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788643174.109549:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+10:18099:x1875527675822848:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 171us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643174.109557:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 129 00000100:00100000:0.0:1788643174.119153:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643174.119247:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675822976 00000100:00100000:1.0:1788643174.119256:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675822976 00000100:00100000:1.0:1788643174.119310:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 130 00000100:00100000:1.0:1788643174.119319:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+10:18099:x1875527675822976:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788643174.119508:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+10:18099:x1875527675822976:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 189us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643174.119517:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 130 00000100:00100000:3.0:1788643174.133251:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643174.133332:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643174.133584:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675823104 00000100:00100000:0.0:1788643174.133593:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675823104 00000100:00100000:0.0:1788643174.133651:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675823360 00000100:00100000:0.0:1788643174.133655:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675823360 00000100:00100000:0.0:1788643174.133675:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:0.0:1788643174.133683:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875527675823104:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788643174.133731:0:22752:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9405b2ce-0895-49c4-b1fc-39176eea3e3f@192.168.206.18@tcp t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:0.0:1788643174.133779:0:22752:0:(genops.c:1385:class_connect()) connect: client 9405b2ce-0895-49c4-b1fc-39176eea3e3f, cookie 0x119ccc6e683c41a0 00000004:00100000:0.0:1788643174.133800:0:22752:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788643174.133998:0:22752:0:(import.c:65:import_set_state_nolock()) ffff9cacc54b0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788643174.134064:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:2398:x1875527675823104:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 380us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643174.134078:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:0.0:1788643174.134097:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:0.0:1788643174.134102:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875527675823360:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788643174.134119:0:22752:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 9405b2ce-0895-49c4-b1fc-39176eea3e3f@192.168.206.18@tcp t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:1.0:1788643174.135311:0:22752:0:(genops.c:1385:class_connect()) connect: client 9405b2ce-0895-49c4-b1fc-39176eea3e3f, cookie 0x119ccc6e683c41a7 00000004:00100000:1.0:1788643174.135334:0:22752:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788643174.135561:0:22752:0:(import.c:65:import_set_state_nolock()) ffff9cacd70bc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788643174.135657:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:2398:x1875527675823360:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 1552us (2323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643174.135666:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:3.0:1788643174.138767:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643174.138858:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643174.139088:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643174.139252:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675823616 00000100:00100000:1.0:1788643174.139273:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675823616 00000100:00100000:1.0:1788643174.139345:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675823488 00000100:00100000:1.0:1788643174.139349:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675823488 00000100:00100000:1.0:1788643174.139376:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:1.0:1788643174.139415:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18076:x1875527675823616:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788643174.139444:0:22753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788643174.139517:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18076:x1875527675823616:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 104us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643174.139524:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:1.0:1788643174.139541:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:1.0:1788643174.139548:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:0:x1875527675823488:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788643174.139560:0:22753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788643174.139594:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:0:x1875527675823488:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 47us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643174.139600:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00080000:2.0:1788643174.141282:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788643174.141290:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788643174.142240:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675823232 00000100:00100000:0.0:1788643174.142251:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675823232 00000100:00100000:1.0:1788643174.142367:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:1.0:1788643174.145296:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:0:x1875527675823232:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788643174.145345:0:22753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788643174.145510:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:0:x1875527675823232:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 3130us (6418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643174.145519:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:2.0:1788643174.148150:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643174.148656:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675823744 00000100:00100000:3.0:1788643174.148664:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675823744 00000100:00100000:3.0:1788643174.148819:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:3.0:1788643174.148830:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18076:x1875527675823744:12345-192.168.206.18@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788643174.148909:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18076:x1875527675823744:12345-192.168.206.18@tcp:40:mount.lustre.0 Request processed in 81us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643174.148917:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:1.0:1788643174.151947:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643174.151993:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643174.152029:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643174.152120:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675824128 00000100:00100000:0.0:1788643174.152128:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675824128 00000100:00100000:0.0:1788643174.152175:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:0.0:1788643174.152183:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18076:x1875527675824128:12345-192.168.206.18@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788643174.152243:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18076:x1875527675824128:12345-192.168.206.18@tcp:900:mount.lustre.0 Request processed in 61us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643174.152250:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:2.0:1788643174.152569:0:25142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675823872 00000100:00100000:2.0:1788643174.152574:0:25142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675823872 00000100:00100000:2.0:1788643174.152608:0:25142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675824000 00000100:00100000:2.0:1788643174.152611:0:25142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675824000 00000100:00100000:2.0:1788643174.152625:0:25142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:2.0:1788643174.152630:0:25142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1875527675823872:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788643174.152654:0:25142:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9405b2ce-0895-49c4-b1fc-39176eea3e3f@192.168.206.18@tcp t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:2.0:1788643174.152679:0:25142:0:(genops.c:1385:class_connect()) connect: client 9405b2ce-0895-49c4-b1fc-39176eea3e3f, cookie 0x119ccc6e683c41ae 00002000:00100000:2.0:1788643174.152701:0:25142:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9405b2ce-0895-49c4-b1fc-39176eea3e3f/ffff9cacc3243000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788643174.152719:0:25142:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788643174.152872:0:25142:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788643174.152899:0:25142:0:(import.c:65:import_set_state_nolock()) ffff9cacc3240800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788643174.152933:0:25142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:2398:x1875527675823872:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 302us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643174.152940:0:25142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:2.0:1788643174.152953:0:25142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:2.0:1788643174.152957:0:25142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1875527675824000:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788643174.152984:0:25142:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9405b2ce-0895-49c4-b1fc-39176eea3e3f@192.168.206.18@tcp t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:2.0:1788643174.152999:0:25142:0:(genops.c:1385:class_connect()) connect: client 9405b2ce-0895-49c4-b1fc-39176eea3e3f, cookie 0x119ccc6e683c41b5 00002000:00100000:2.0:1788643174.153004:0:25142:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9405b2ce-0895-49c4-b1fc-39176eea3e3f/ffff9cacc3246000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788643174.153015:0:25142:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788643174.153108:0:25142:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788643174.153124:0:25142:0:(import.c:65:import_set_state_nolock()) ffff9cabc7982000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788643174.153145:0:25142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:2398:x1875527675824000:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 187us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643174.153152:0:25142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:1.0:1788643174.164481:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643174.164602:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675824256 00000100:00100000:2.0:1788643174.164611:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675824256 00000100:00100000:2.0:1788643174.164652:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:2.0:1788643174.164662:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18076:x1875527675824256:12345-192.168.206.18@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788643174.165790:0:22755:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1031us 00000004:00200000:0.0:1788643174.180692:0:22755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788643174.180875:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18076:x1875527675824256:12345-192.168.206.18@tcp:33:mount.lustre.0 Request processed in 16209us (16398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643174.180890:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:2.0:1788643174.307819:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643174.307912:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675824384 00000100:00100000:0.0:1788643174.307922:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675824384 00000100:00100000:0.0:1788643174.308025:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 13 00000100:00100000:0.0:1788643174.308047:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18122:x1875527675824384:12345-192.168.206.18@tcp:101:mkdir.0 00010000:00010000:0.0:1788643174.308065:0:24283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643174.308088:0:24283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8600/0x119ccc6e683c41bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c8df expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643174.308147:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9a00/0x119ccc6e683c41c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643174.308159:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9a00/0x119ccc6e683c41c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643174.308172:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9a00/0x119ccc6e683c41c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788643174.308212:0:24283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788643174.308216:0:24283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788643174.308250:0:24283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9a00/0x119ccc6e683c41c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643174.308273:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8600/0x119ccc6e683c41bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8df expref: 8 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643174.308695:0:24283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9a00/0x119ccc6e683c41c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8df expref: 7 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643174.308730:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558f00) 00010000:00010000:0.0:1788643174.308733:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788643174.308737:0:24283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacff5e9a00, rc 0) 00000100:00100000:0.0:1788643174.308841:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+7:18122:x1875527675824384:12345-192.168.206.18@tcp:101:mkdir.0 Request processed in 807us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643174.308849:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 13 00010000:00010000:0.0:1788643174.539610:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788643174.801425:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788643175.563809:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643176.180765:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.180868:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675824512 00000100:00100000:1.0:1788643176.180877:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675824512 00000100:00100000:1.0:1788643176.180947:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00100000:1.0:1788643176.180957:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+7:18174:x1875527675824512:12345-192.168.206.18@tcp:41:lfs.0 00000004:00000024:1.0:1788643176.181000:0:22753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788643176.181091:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+7:18174:x1875527675824512:12345-192.168.206.18@tcp:41:lfs.0 Request processed in 135us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.181098:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 14 00000100:00080000:2.0:1788643176.181308:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788643176.212431:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.212553:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675824640 00000100:00100000:1.0:1788643176.212563:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675824640 00000100:00100000:1.0:1788643176.212632:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:1.0:1788643176.212642:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18174:x1875527675824640:12345-192.168.206.18@tcp:41:lfs.0 00000004:00000024:1.0:1788643176.212675:0:22752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788643176.212776:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18174:x1875527675824640:12345-192.168.206.18@tcp:41:lfs.0 Request processed in 134us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.212784:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00080000:2.0:1788643176.214989:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788643176.218843:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.218978:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675824768 00000100:00100000:1.0:1788643176.218988:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675824768 00000100:00100000:1.0:1788643176.219062:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:1.0:1788643176.219073:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18174:x1875527675824768:12345-192.168.206.18@tcp:13:lfs.0 00002000:00000024:1.0:1788643176.219104:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788643176.219189:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18174:x1875527675824768:12345-192.168.206.18@tcp:13:lfs.0 Request processed in 118us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.219196:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00080000:2.0:1788643176.219309:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788643176.221305:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.221455:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675824896 00000100:00100000:1.0:1788643176.221462:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675824896 00000100:00100000:1.0:1788643176.221527:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:1.0:1788643176.221537:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18174:x1875527675824896:12345-192.168.206.18@tcp:13:lfs.0 00002000:00000024:1.0:1788643176.221584:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788643176.221656:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18174:x1875527675824896:12345-192.168.206.18@tcp:13:lfs.0 Request processed in 122us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.221664:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00080000:2.0:1788643176.222166:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788643176.437241:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643176.441770:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675825024 00000100:00100000:2.0:1788643176.441786:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675825024 00000100:00100000:2.0:1788643176.442081:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 131 00000100:00100000:2.0:1788643176.442093:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+10:18205:x1875527675825024:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788643176.442111:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643176.442130:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cabc7495200/0x119ccc6e683c41ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c8e6 expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643176.442175:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cabc7495200/0x119ccc6e683c41ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8e6 expref: 11 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643176.442188:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cabc7495200/0x119ccc6e683c41ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8e6 expref: 11 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643176.442198:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7495200, rc 0) 00000100:00100000:2.0:1788643176.442268:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+11:18205:x1875527675825024:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 177us (5037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643176.442275:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 131 00000100:00100000:3.0:1788643176.446221:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.446334:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675825152 00000100:00100000:1.0:1788643176.446345:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675825152 00000100:00100000:1.0:1788643176.446430:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 132 00000100:00100000:1.0:1788643176.446440:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+11:18205:x1875527675825152:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788643176.446586:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+11:18205:x1875527675825152:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 147us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.446594:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 132 00000100:00100000:3.0:1788643176.459275:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.459416:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675825280 00000100:00100000:1.0:1788643176.459425:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675825280 00000100:00100000:1.0:1788643176.459483:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 133 00000100:00100000:1.0:1788643176.459493:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+11:18205:x1875527675825280:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788643176.459687:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+11:18205:x1875527675825280:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 189us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.459704:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 133 00000100:00100000:3.0:1788643176.473073:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643176.477113:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675825408 00000100:00100000:2.0:1788643176.477127:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675825408 00000100:00100000:2.0:1788643176.477193:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 134 00000100:00100000:2.0:1788643176.477202:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+11:18213:x1875527675825408:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788643176.477550:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+11:18213:x1875527675825408:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 347us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643176.477558:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 134 00000100:00100000:0.0:1788643176.512054:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643176.512226:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675825536 00000100:00100000:2.0:1788643176.512236:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675825536 00000100:00100000:2.0:1788643176.512421:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 135 00000100:00100000:2.0:1788643176.512433:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+11:18213:x1875527675825536:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788643176.512580:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+11:18213:x1875527675825536:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 149us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643176.512588:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 135 00000100:00100000:3.0:1788643176.519258:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643176.521423:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675825664 00000100:00100000:2.0:1788643176.521456:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675825664 00000100:00100000:2.0:1788643176.521524:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 136 00000100:00100000:2.0:1788643176.521535:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+11:18213:x1875527675825664:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788643176.521684:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+11:18213:x1875527675825664:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 151us (2436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643176.521692:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 136 00000100:00100000:3.0:1788643176.530048:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643176.530184:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675825792 00000100:00100000:2.0:1788643176.530194:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675825792 00000100:00100000:2.0:1788643176.530315:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 137 00000100:00100000:2.0:1788643176.530325:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+11:18205:x1875527675825792:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788643176.530341:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643176.530359:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cabc7494a00/0x119ccc6e683c41d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c917 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643176.530409:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cabc7494a00/0x119ccc6e683c41d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c917 expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643176.530421:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cabc7494a00/0x119ccc6e683c41d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c917 expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643176.530430:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7494a00, rc 0) 00000100:00100000:2.0:1788643176.530486:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+12:18205:x1875527675825792:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 163us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643176.530493:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 137 00000100:00100000:3.0:1788643176.535445:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643176.538538:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675825920 00000100:00100000:0.0:1788643176.538553:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675825920 00000100:00100000:1.0:1788643176.538642:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 138 00000100:00100000:1.0:1788643176.538657:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+12:18205:x1875527675825920:12345-192.168.206.18@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788643176.538684:0:22746:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788643176.538727:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788643176.538731:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788643176.538735:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788643176.538738:0:22746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788643176.538740:0:22746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788643176.541129:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+12:18205:x1875527675825920:12345-192.168.206.18@tcp:256:mount.lustre.0 Request processed in 2466us (5682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.541141:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 138 00000100:00100000:2.0:1788643176.548259:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.548535:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675826048 00000100:00100000:1.0:1788643176.548546:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675826048 00000100:00100000:1.0:1788643176.548608:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 139 00000100:00100000:1.0:1788643176.548618:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+12:18205:x1875527675826048:12345-192.168.206.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788643176.548635:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788643176.548653:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacc0030600/0x119ccc6e683c41d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c91e expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643176.548679:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacc0030600/0x119ccc6e683c41d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c91e expref: 13 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643176.548704:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacc0030600/0x119ccc6e683c41d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c91e expref: 13 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643176.548714:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacc0030600, rc 0) 00000100:00100000:1.0:1788643176.548784:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+13:18205:x1875527675826048:12345-192.168.206.18@tcp:101:mount.lustre.0 Request processed in 167us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.548791:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 139 00000100:00100000:3.0:1788643176.555789:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.555941:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675826176 00000100:00100000:1.0:1788643176.555950:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675826176 00000100:00100000:1.0:1788643176.556001:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 140 00000100:00100000:1.0:1788643176.556016:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+13:18205:x1875527675826176:12345-192.168.206.18@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788643176.556173:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+13:18205:x1875527675826176:12345-192.168.206.18@tcp:501:mount.lustre.0 Request processed in 157us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.556182:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 140 00000100:00100000:3.0:1788643176.562869:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.562965:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675826304 00000100:00100000:1.0:1788643176.562974:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675826304 00000100:00100000:1.0:1788643176.563037:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 141 00000100:00100000:1.0:1788643176.563047:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+13:18205:x1875527675826304:12345-192.168.206.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788643176.563182:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+13:18205:x1875527675826304:12345-192.168.206.18@tcp:503:mount.lustre.0 Request processed in 136us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.563191:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 141 00000100:00100000:2.0:1788643176.569651:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.570051:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675826432 00000100:00100000:1.0:1788643176.570060:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675826432 00000100:00100000:1.0:1788643176.570113:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 142 00000100:00100000:1.0:1788643176.570122:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+13:18218:x1875527675826432:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788643176.570284:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+13:18218:x1875527675826432:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 161us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.570291:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 142 00000100:00100000:3.0:1788643176.572487:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.572611:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675826560 00000100:00100000:1.0:1788643176.572620:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675826560 00000100:00100000:1.0:1788643176.572685:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 143 00000100:00100000:1.0:1788643176.572702:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+13:18218:x1875527675826560:12345-192.168.206.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788643176.572848:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+13:18218:x1875527675826560:12345-192.168.206.18@tcp:502:llog_process_th.0 Request processed in 155us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.572866:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 143 00000100:00100000:3.0:1788643176.576821:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643176.576899:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643176.577112:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675826688 00000100:00100000:2.0:1788643176.577132:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675826688 00000100:00100000:2.0:1788643176.577172:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675826944 00000100:00100000:2.0:1788643176.577175:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675826944 00000100:00100000:2.0:1788643176.577200:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:2.0:1788643176.577207:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1875527675826688:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788643176.577237:0:22754:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c19b19f4-27dd-4e30-b734-f16bf35fa52d@192.168.206.18@tcp t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1788643176.577635:0:22754:0:(genops.c:1385:class_connect()) connect: client c19b19f4-27dd-4e30-b734-f16bf35fa52d, cookie 0x119ccc6e683c41df 00000004:00100000:2.0:1788643176.577661:0:22754:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788643176.577854:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:1.0:1788643176.577861:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1875527675826944:12345-192.168.206.18@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788643176.577879:0:22753:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c19b19f4-27dd-4e30-b734-f16bf35fa52d@192.168.206.18@tcp t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:1.0:1788643176.577905:0:22753:0:(genops.c:1385:class_connect()) connect: client c19b19f4-27dd-4e30-b734-f16bf35fa52d, cookie 0x119ccc6e683c41e6 00000004:00100000:1.0:1788643176.577918:0:22753:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788643176.577976:0:22753:0:(import.c:65:import_set_state_nolock()) ffff9cacd8150000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788643176.578050:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:2398:x1875527675826944:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 187us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.578058:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00080000:2.0:1788643176.580684:0:22754:0:(import.c:65:import_set_state_nolock()) ffff9cacff7b4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788643176.580774:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:2398:x1875527675826688:12345-192.168.206.18@tcp:38:mount.lustre.0 Request processed in 3562us (3960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643176.580786:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00010000:00010000:0.0:1788643176.588376:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643176.593235:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643176.593280:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643176.593372:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675827072 00000100:00100000:0.0:1788643176.593413:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675827072 00000100:00100000:0.0:1788643176.593481:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675826816 00000100:00100000:0.0:1788643176.593484:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675826816 00000100:00100000:0.0:1788643176.593513:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:0.0:1788643176.593522:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:0:x1875527675827072:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788643176.593552:0:24283:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788643176.593616:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:0:x1875527675827072:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 95us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643176.593624:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:0.0:1788643176.593642:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:0.0:1788643176.593649:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:0:x1875527675826816:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788643176.593660:0:24283:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788643176.593720:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:0:x1875527675826816:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 72us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643176.593727:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:3.0:1788643176.594874:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643176.595016:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675827200 00000100:00100000:0.0:1788643176.595032:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675827200 00000100:00100000:0.0:1788643176.595078:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:0.0:1788643176.595086:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:18205:x1875527675827200:12345-192.168.206.18@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788643176.595107:0:24283:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788643176.595157:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:18205:x1875527675827200:12345-192.168.206.18@tcp:41:mount.lustre.0 Request processed in 71us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643176.595164:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00080000:2.0:1788643176.595282:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788643176.595287:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788643176.609875:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643176.610048:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675827328 00000100:00100000:1.0:1788643176.610058:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675827328 00000100:00100000:1.0:1788643176.610113:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:1.0:1788643176.610123:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:18205:x1875527675827328:12345-192.168.206.18@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788643176.610217:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:18205:x1875527675827328:12345-192.168.206.18@tcp:40:mount.lustre.0 Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643176.610225:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:3.0:1788643176.612456:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643176.612767:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643176.612842:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643176.612986:0:25142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675827456 00000100:00100000:2.0:1788643176.612995:0:25142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675827456 00000100:00100000:2.0:1788643176.613043:0:25142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675827584 00000100:00100000:2.0:1788643176.613046:0:25142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675827584 00000100:00100000:2.0:1788643176.613067:0:25142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:2.0:1788643176.613075:0:25142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1875527675827456:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788643176.613106:0:25142:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c19b19f4-27dd-4e30-b734-f16bf35fa52d@192.168.206.18@tcp t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1788643176.613136:0:25142:0:(genops.c:1385:class_connect()) connect: client c19b19f4-27dd-4e30-b734-f16bf35fa52d, cookie 0x119ccc6e683c41ed 00002000:00100000:2.0:1788643176.613148:0:25142:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c19b19f4-27dd-4e30-b734-f16bf35fa52d/ffff9cacff7b1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788643176.613157:0:25142:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788643176.613223:0:25142:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788643176.613254:0:25142:0:(import.c:65:import_set_state_nolock()) ffff9cacff7b6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788643176.613314:0:25142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:2398:x1875527675827456:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 238us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643176.613335:0:25142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:2.0:1788643176.613350:0:25142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:2.0:1788643176.613354:0:25142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1875527675827584:12345-192.168.206.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788643176.613370:0:25142:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c19b19f4-27dd-4e30-b734-f16bf35fa52d@192.168.206.18@tcp t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1788643176.613405:0:25142:0:(genops.c:1385:class_connect()) connect: client c19b19f4-27dd-4e30-b734-f16bf35fa52d, cookie 0x119ccc6e683c41f4 00002000:00100000:2.0:1788643176.613411:0:25142:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c19b19f4-27dd-4e30-b734-f16bf35fa52d/ffff9cacff7b6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788643176.613417:0:25142:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788643176.613446:0:25142:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788643176.613460:0:25142:0:(import.c:65:import_set_state_nolock()) ffff9cacff7b0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788643176.613483:0:25142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:2398:x1875527675827584:12345-192.168.206.18@tcp:8:mount.lustre.0 Request processed in 127us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643176.613489:0:25142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:0.0:1788643176.613769:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675827712 00000100:00100000:0.0:1788643176.613774:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675827712 00000100:00100000:0.0:1788643176.613813:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:0.0:1788643176.613821:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:18205:x1875527675827712:12345-192.168.206.18@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788643176.613871:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:18205:x1875527675827712:12345-192.168.206.18@tcp:900:mount.lustre.0 Request processed in 51us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643176.613878:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:3.0:1788643176.617299:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643176.618249:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675827840 00000100:00100000:0.0:1788643176.618260:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675827840 00000100:00100000:0.0:1788643176.618326:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:0.0:1788643176.618335:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:18205:x1875527675827840:12345-192.168.206.18@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788643176.618449:0:22756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788643176.618519:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:18205:x1875527675827840:12345-192.168.206.18@tcp:33:mount.lustre.0 Request processed in 185us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643176.618535:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:1.0:1788643176.651584:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696901504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788643176.651656:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643176.651826:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacf7f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696901632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788643176.651858:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643176.651941:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696901504 00000100:00100000:2.0:1788643176.651949:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696901504 00000100:00100000:2.0:1788643176.651991:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696901632 00000100:00100000:2.0:1788643176.651995:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696901632 00000100:00100000:2.0:1788643176.652012:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788643176.652019:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696901504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788643176.652054:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788643176.652353:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc88e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696901760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788643176.652404:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788643176.652443:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788643176.652594:0:24263:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788643176.652603:0:24263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788643176.652798:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696901760 00000100:00100000:0.0:1788643176.652802:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696901760 00000100:00100000:0.0:1788643176.652897:0:25551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788643176.652905:0:25551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696901632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788643176.652918:0:25551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788643176.652953:0:25551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696901632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643176.652959:0:25551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788643176.652973:0:25551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788643176.652978:0:25551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696901760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788643176.652986:0:25551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788643176.653006:0:25551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696901760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 28us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643176.653011:0:25551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788643176.653198:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696902272:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653226:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643176.653252:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875527696902784:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653272:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643176.653306:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc88e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696901760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788643176.653321:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788643176.653326:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696901888:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653351:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643176.653375:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696902400:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653423:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643176.653440:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875527696902912:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653480:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643176.653508:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696902784 00000100:00100000:3.0:1788643176.653512:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696902784 00000100:00100000:3.0:1788643176.653540:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696902912 00000100:00100000:3.0:1788643176.653542:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696902912 00000100:00100000:3.0:1788643176.653559:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788643176.653565:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875527696902784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653598:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875527696902784:12345-0@lo:400:kworker.0 Request processed in 32us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643176.653605:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788643176.653617:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788643176.653622:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875527696902912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653662:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875527696902912:12345-0@lo:400:kworker.0 Request processed in 39us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643176.653667:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788643176.653704:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696901888 00000100:00100000:3.0:1788643176.653708:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696901888 00000100:00100000:3.0:1788643176.653731:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788643176.653737:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+24:3644:x1875527696901888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653765:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+24:3644:x1875527696901888:12345-0@lo:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643176.653770:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788643176.653797:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696902400 00000100:00100000:3.0:1788643176.653800:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696902400 00000100:00100000:3.0:1788643176.653826:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788643176.653832:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696902400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653860:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696902400:12345-0@lo:400:kworker.0 Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643176.653871:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788643176.653887:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788643176.653891:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788643176.653893:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788643176.653913:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696901888:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696902400:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653931:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875527696902912:0@lo:400:kworker.0 00010000:00080000:3.0:1788643176.653941:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7e30a80 x1875527696902784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643176.653951:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875527696902784:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.653989:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875527696902144:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.654011:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643176.654252:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875527696902656:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.654276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643176.654302:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788643176.654318:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacf7f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696901632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788643176.654331:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788643176.654337:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696902016:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.654360:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643176.654377:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875527696902528:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.654417:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643176.654433:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875527696903040:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.654467:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643176.654492:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696902144 00000100:00100000:3.0:1788643176.654496:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696902144 00000100:00100000:3.0:1788643176.654514:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696902656 00000100:00100000:3.0:1788643176.654516:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696902656 00000100:00100000:3.0:1788643176.654532:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696902528 00000100:00100000:3.0:1788643176.654535:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696902528 00000100:00100000:3.0:1788643176.654543:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696903040 00000100:00100000:3.0:1788643176.654545:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696903040 00000100:00100000:3.0:1788643176.654562:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788643176.654568:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875527696902144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.654602:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875527696902144:12345-0@lo:400:kworker.0 Request processed in 34us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643176.654608:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788643176.654620:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788643176.654626:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875527696902656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.654652:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875527696902656:12345-0@lo:400:kworker.0 Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643176.654658:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788643176.654668:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788643176.654688:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875527696902528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.654726:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875527696902528:12345-0@lo:400:kworker.0 Request processed in 51us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643176.654732:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788643176.654743:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788643176.654750:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875527696903040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.654776:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875527696903040:12345-0@lo:400:kworker.0 Request processed in 27us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643176.654787:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788643176.654802:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788643176.654805:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788643176.654822:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875527696902528:0@lo:400:kworker.0 00010000:00080000:3.0:1788643176.654833:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc7e30000 x1875527696903040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643176.654843:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875527696903040:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.654853:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875527696902144:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.654862:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875527696902656:0@lo:400:kworker.0 00000100:00100000:0.0:1788643176.656399:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696902272 00000100:00100000:0.0:1788643176.656410:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696902272 00000100:00100000:0.0:1788643176.656459:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696902016 00000100:00100000:0.0:1788643176.656463:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696902016 00000100:00100000:0.0:1788643176.656480:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788643176.656489:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc88eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696902272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643176.656564:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc88eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696902272:12345-0@lo:400:kworker.0 Request processed in 76us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643176.656570:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788643176.656598:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788643176.656604:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696902016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788643176.656640:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696902016:12345-0@lo:400:kworker.0 Request processed in 36us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643176.656646:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788643176.657132:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696902272:0@lo:400:kworker.0 00000100:00100000:3.0:1788643176.657163:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696902016:0@lo:400:kworker.0 00000100:00100000:2.0:1788643176.664410:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696901504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12292us (12655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643176.664425:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788643176.665259:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696901504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788643176.821250:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643176.821577:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675827968 00000100:00100000:3.0:1788643176.821587:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675827968 00000100:00100000:3.0:1788643176.821656:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:3.0:1788643176.821668:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:18241:x1875527675827968:12345-192.168.206.18@tcp:101:mkdir.0 00010000:00010000:3.0:1788643176.821708:0:24283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643176.821731:0:24283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d000/0x119ccc6e683c41fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c94f expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643176.821794:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643176.821807:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643176.821848:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788643176.821894:0:24283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788643176.821898:0:24283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788643176.821917:0:24283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643176.821941:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d000/0x119ccc6e683c41fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c94f expref: 8 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643176.821959:0:24283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c94f expref: 7 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643176.822255:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558f00) 00010000:00010000:3.0:1788643176.822259:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788643176.822263:0:24283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacf6d3d600, rc 0) 00000100:00100000:3.0:1788643176.822338:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+7:18241:x1875527675827968:12345-192.168.206.18@tcp:101:mkdir.0 Request processed in 671us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643176.822345:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00010000:00010000:1.0:1788643177.612960:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643178.190245:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696903168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788643178.190314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643178.190413:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696903168 00000100:00100000:1.0:1788643178.190421:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696903168 00000100:00100000:1.0:1788643178.190476:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788643178.190486:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696903168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788643178.190515:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788643178.190565:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696903168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643178.190573:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788643178.190595:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788643178.190627:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696903168:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788643178.637050:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788643179.212108:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788643179.212129:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696903296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788643179.212190:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643179.212243:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696903424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788643179.212266:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643179.212298:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696903296 00000100:00100000:0.0:1788643179.212300:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696903424 00000100:00100000:3.0:1788643179.212305:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696903296 00000100:00100000:0.0:1788643179.212305:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696903424 00000100:00100000:3.0:1788643179.212348:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788643179.212357:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696903296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788643179.212425:0:22757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788643179.212471:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696903296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643179.212478:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788643179.212493:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788643179.212498:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696903424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788643179.212513:0:22757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788643179.212540:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696903424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643179.212545:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788643179.217937:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696903424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788643179.218765:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696903296:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788643179.661891:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788643179.728179:0:24255:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c19b19f4-27dd-4e30-b734-f16bf35fa52d 00000001:00100000:3.0:1788643179.728191:0:24255:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9405b2ce-0895-49c4-b1fc-39176eea3e3f 00000001:00100000:0.0:1788643179.732055:0:22732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c19b19f4-27dd-4e30-b734-f16bf35fa52d 00000001:00100000:0.0:1788643179.732067:0:22732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9405b2ce-0895-49c4-b1fc-39176eea3e3f 00000001:00100000:0.0:1788643179.736933:0:23485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c19b19f4-27dd-4e30-b734-f16bf35fa52d 00000001:00100000:0.0:1788643179.736945:0:23485:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9405b2ce-0895-49c4-b1fc-39176eea3e3f 00000001:00100000:0.0:1788643179.737114:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c19b19f4-27dd-4e30-b734-f16bf35fa52d 00000001:00100000:0.0:1788643179.737121:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9405b2ce-0895-49c4-b1fc-39176eea3e3f 00000001:02000400:3.0:1788643179.958546:0:25636:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788643180.684737:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643181.708556:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643181.771544:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cacc978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696903552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788643181.771584:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788643181.771599:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696903808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788643181.771621:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643181.771640:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643181.771679:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788643181.771686:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696903680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788643181.772007:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696903936:0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.772040:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643181.772061:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696904448:0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.772084:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643181.772102:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875527696904960:0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.772127:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643181.772146:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788643181.772160:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875527696904320:0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.772184:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643181.772199:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875527696904832:0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.772219:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643181.772247:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696904448 00000100:00100000:3.0:1788643181.772254:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696904448 00000100:00100000:3.0:1788643181.772293:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788643181.772302:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696904448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.772351:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696904448:12345-0@lo:400:kworker.0 Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643181.772359:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788643181.772404:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696904960 00000100:00100000:3.0:1788643181.772408:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696904960 00000100:00100000:3.0:1788643181.772440:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696904320 00000100:00100000:3.0:1788643181.772444:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696904320 00000100:00100000:3.0:1788643181.772456:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696904832 00000100:00100000:3.0:1788643181.772459:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696904832 00000100:00100000:3.0:1788643181.772472:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788643181.772477:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875527696904960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.772508:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875527696904960:12345-0@lo:400:kworker.0 Request processed in 30us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643181.772514:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788643181.772527:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788643181.772533:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875527696904320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.772560:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875527696904320:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643181.772566:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788643181.772586:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788643181.772592:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875527696904832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.772621:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875527696904832:12345-0@lo:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643181.772626:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788643181.772757:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696903936 00000100:00100000:2.0:1788643181.772761:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696903936 00000100:00100000:2.0:1788643181.772791:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788643181.772798:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+24:3645:x1875527696903936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643181.772831:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+24:3645:x1875527696903936:12345-0@lo:400:kworker.0 Request processed in 35us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643181.772837:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788643181.772866:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643181.773009:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875527696904320:0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.773023:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875527696904832:0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.773030:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696903936:0@lo:400:kworker.0 00000100:00100000:3.0:1788643181.773039:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696904448:0@lo:400:kworker.0 00010000:00080000:3.0:1788643181.773049:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc8b30700 x1875527696904960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788643181.773059:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875527696904960:0@lo:400:kworker.0 00000100:00100000:1.0:1788643181.774852:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696903552 00000100:00100000:1.0:1788643181.774859:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696903552 00000100:00100000:1.0:1788643181.774889:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696903808 00000100:00100000:1.0:1788643181.774892:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696903808 00000100:00100000:1.0:1788643181.774903:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696903680 00000100:00100000:1.0:1788643181.774905:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696903680 00000100:00100000:1.0:1788643181.774922:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788643181.774923:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696904064:0@lo:400:kworker.0 00000100:00100000:1.0:1788643181.774931:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696903552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788643181.774958:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788643181.774974:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643181.775001:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696904576:0@lo:400:kworker.0 00000100:00100000:1.0:1788643181.775006:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696903552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (3384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643181.775015:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788643181.775032:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643181.775039:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788643181.775048:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696903808:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788643181.775058:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875527696905088:0@lo:400:kworker.0 00002000:00000024:1.0:1788643181.775064:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788643181.775087:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643181.775114:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696903808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (3475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643181.775120:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788643181.775136:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cacc978c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696903552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788643181.775136:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788643181.775147:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696903680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788643181.775157:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788643181.775158:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788643181.775167:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696904192:0@lo:400:kworker.0 00000100:00100000:1.0:1788643181.775183:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696903680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643181.775190:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788643181.775200:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643181.775233:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875527696904704:0@lo:400:kworker.0 00000100:00100000:2.0:1788643181.775254:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643181.775273:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875527696905216:0@lo:400:kworker.0 00000100:00100000:2.0:1788643181.775416:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643181.775446:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696903680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788643181.775473:0:24706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696904576 00000100:00100000:2.0:1788643181.775477:0:24706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696904576 00000100:00100000:2.0:1788643181.775505:0:24706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696904192 00000100:00100000:2.0:1788643181.775508:0:24706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696904192 00000100:00100000:2.0:1788643181.775528:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788643181.775535:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696904576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643181.775572:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696904576:12345-0@lo:400:kworker.0 Request processed in 37us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643181.775579:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788643181.775593:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788643181.775599:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696904192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643181.775628:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696904192:12345-0@lo:400:kworker.0 Request processed in 29us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643181.775635:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788643181.775657:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696905088 00000100:00100000:2.0:1788643181.775660:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696905088 00000100:00100000:2.0:1788643181.775700:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696904704 00000100:00100000:2.0:1788643181.775703:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696904704 00000100:00100000:2.0:1788643181.775715:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696905216 00000100:00100000:2.0:1788643181.775717:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696905216 00000100:00100000:2.0:1788643181.775732:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788643181.775738:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875527696905088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643181.775769:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875527696905088:12345-0@lo:400:kworker.0 Request processed in 31us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643181.775776:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788643181.775794:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788643181.775799:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875527696904704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643181.775826:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875527696904704:12345-0@lo:400:kworker.0 Request processed in 27us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643181.775832:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788643181.775843:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788643181.775848:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875527696905216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643181.775970:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875527696905216:12345-0@lo:400:kworker.0 Request processed in 121us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643181.775977:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788643181.776013:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696904192:0@lo:400:kworker.0 00000100:00100000:2.0:1788643181.776022:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875527696904704:0@lo:400:kworker.0 00010000:00080000:2.0:1788643181.776033:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cabc6bd7b80 x1875527696905216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643181.776042:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875527696905216:0@lo:400:kworker.0 00000100:00100000:2.0:1788643181.776051:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696904576:0@lo:400:kworker.0 00000100:00100000:2.0:1788643181.776060:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875527696905088:0@lo:400:kworker.0 00000100:00080000:1.0:1788643181.776425:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788643181.776429:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788643181.776433:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788643181.776435:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788643181.776449:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696904064 00000100:00100000:1.0:1788643181.776454:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696904064 00000100:00100000:1.0:1788643181.776491:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788643181.776499:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696904064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643181.776550:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696904064:12345-0@lo:400:kworker.0 Request processed in 53us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643181.776558:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788643181.776561:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696904064:0@lo:400:kworker.0 00000100:00100000:1.0:1788643181.776784:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696903808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788643181.862157:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643181.862201:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643181.862239:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643181.862444:0:25142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675828608 00000100:00100000:3.0:1788643181.862453:0:25142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675828608 00000100:00100000:3.0:1788643181.862523:0:25142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:3.0:1788643181.862535:0:25142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2399:x1875527675828608:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643181.862659:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675828096 00000100:00100000:0.0:1788643181.862664:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675828096 00000100:00100000:0.0:1788643181.862703:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 146 00000100:00100000:0.0:1788643181.862711:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+13:2399:x1875527675828096:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:2.0:1788643181.862830:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675828352 00000100:00100000:2.0:1788643181.862835:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675828352 00000100:00100000:2.0:1788643181.862869:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:2.0:1788643181.862875:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc978c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2399:x1875527675828352:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788643181.863072:0:25142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2399:x1875527675828608:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 538us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643181.863072:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+13:2399:x1875527675828096:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 360us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643181.863082:0:25142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:0.0:1788643181.863082:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 146 00000100:00080000:3.0:1788643181.863106:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788643181.863110:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788643181.863175:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc978c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2399:x1875527675828352:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 300us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643181.863175:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643181.863190:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:2.0:1788643181.863282:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675828224 00000100:00100000:2.0:1788643181.863287:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675828224 00000100:00100000:1.0:1788643181.863290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643181.863320:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643181.863373:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675828480 00000100:00100000:1.0:1788643181.863494:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643181.863526:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675828736 00000100:00100000:3.0:1788643181.863530:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675828736 00000100:00100000:3.0:1788643181.863554:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:3.0:1788643181.863568:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacf7f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:2399:x1875527675828224:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788643181.863603:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacf7f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:2399:x1875527675828224:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 35us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643181.863610:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:3.0:1788643181.863623:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:3.0:1788643181.863629:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:2399:x1875527675828736:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788643181.863651:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:2399:x1875527675828736:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 22us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643181.863656:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:0.0:1788643181.864462:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675828480 00000100:00100000:1.0:1788643181.864647:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643181.864663:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675828992 00000100:00100000:0.0:1788643181.864675:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675828992 00000100:00100000:1.0:1788643181.864690:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643181.864698:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675829120 00000100:00100000:0.0:1788643181.864709:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675829120 00000100:00100000:0.0:1788643181.864732:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:0.0:1788643181.864738:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2399:x1875527675828480:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788643181.864783:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:1.0:1788643181.864791:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2399:x1875527675828992:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:1.0:1788643181.864832:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2399:x1875527675828992:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 42us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643181.864832:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2399:x1875527675828480:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 93us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643181.864839:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:2.0:1788643181.864852:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675828864 00000100:00100000:2.0:1788643181.864856:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675828864 00000100:00100000:0.0:1788643181.864894:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:0.0:1788643181.864907:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00100000:0.0:1788643181.864914:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2399:x1875527675829120:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788643181.864926:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:3.0:1788643181.864934:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2399:x1875527675828864:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788643181.864960:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2399:x1875527675828864:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 27us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643181.864965:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:0.0:1788643181.865467:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2399:x1875527675829120:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 552us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643181.865474:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 12 00000100:00080000:0.0:1788643181.865492:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788643181.865496:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788643181.865498:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788643181.865500:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788643182.732411:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788643183.053593:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788643183.308245:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696905344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788643183.308312:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643183.308561:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696905344 00000100:00100000:3.0:1788643183.308569:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696905344 00000100:00100000:3.0:1788643183.308636:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788643183.308646:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696905344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788643183.308676:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788643183.308723:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875527696905344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643183.308730:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788643183.308800:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875527696905344:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788643183.308843:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788643183.560005:0:25784:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff28a810b0 20000000:00000080:2.0:1788643183.560021:0:25784:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cacd7348400 uarg=0000000000000000 20000000:01000000:2.0:1788643183.560070:0:25784:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788643183.560075:0:25784:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788643183.560079:0:25784:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788643183.563618:0:25785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788643183.564223:0:25784:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788643183.573260:0:25784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788643183.576117:0:25784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576154:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cacf6d3dc00/0x119ccc6e683c3e66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3e5f expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576162:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3e6d expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576169:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cabc7495c00/0x119ccc6e683c3eb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3eac expref: 23 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576175:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c3f4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c3f46 expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576183:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cacff5e9400/0x119ccc6e683c4199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8ae expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576189:0:25784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cacc0030600/0x119ccc6e683c41d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c91e expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576197:0:25784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576236:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cacc0030600/0x119ccc6e683c41d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c91e expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576249:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cacc0030600/0x119ccc6e683c41d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c91e expref: 12 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643183.576262:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696905472:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788643183.576444:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cacff5e9400/0x119ccc6e683c4199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8ae expref: 12 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576459:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cacff5e9400/0x119ccc6e683c4199 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8ae expref: 12 pid: 22746 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643183.576467:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696905600:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788643183.576500:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c3f4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3f46 expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576507:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c3f4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3f46 expref: 23 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643183.576515:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696905728:0@lo:104: 00000100:00100000:3.0:1788643183.576548:0:25784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788643183.576648:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cabc7495c00/0x119ccc6e683c3eb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3eac expref: 23 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.576657:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cabc7495c00/0x119ccc6e683c3eb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3eac expref: 23 pid: 22746 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643183.576680:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696905856:0@lo:104: 00000100:00100000:3.0:1788643183.576702:0:25784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788643183.582049:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3e6d expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.582066:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3e6d expref: 23 pid: 22744 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643183.582078:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696905984:0@lo:104: 00000100:00100000:3.0:1788643183.582127:0:25784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643183.582219:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643183.582289:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643183.582593:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675829376 00000100:00100000:2.0:1788643183.582601:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675829376 00010000:00010000:2.0:1788643183.582632:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cacff5e9400/0x119ccc6e683c4199 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8ae expref: 13 pid: 22746 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643183.582799:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675829248 00000100:00100000:2.0:1788643183.582804:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675829248 00010000:00010000:2.0:1788643183.582820:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cacc0030600/0x119ccc6e683c41d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c91e expref: 14 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643183.582838:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:2.0:1788643183.582846:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce054bfd-e561-4af2-9937-f1d807468f29+14:2402:x1875527675829376:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788643183.582857:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788643183.582862:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cacff5e9400/0x119ccc6e683c4199 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8ae expref: 14 pid: 22746 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.582885:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cacff5e9400/0x119ccc6e683c4199 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8ae expref: 14 pid: 22746 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.582902:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788643183.582944:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce054bfd-e561-4af2-9937-f1d807468f29+14:2402:x1875527675829376:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 97us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643183.582952:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:2.0:1788643183.582970:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:2.0:1788643183.582977:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce054bfd-e561-4af2-9937-f1d807468f29+13:2402:x1875527675829248:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788643183.582985:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788643183.583000:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cacc0030600/0x119ccc6e683c41d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c91e expref: 13 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.583009:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cacc0030600/0x119ccc6e683c41d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c91e expref: 13 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.583018:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788643183.583036:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce054bfd-e561-4af2-9937-f1d807468f29+13:2402:x1875527675829248:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 60us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643183.583043:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:1.0:1788643183.590230:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696905728 00000100:00100000:1.0:1788643183.590244:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696905728 00000100:00100000:1.0:1788643183.590296:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696905856 00000100:00100000:1.0:1788643183.590300:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696905856 00000100:00100000:1.0:1788643183.590318:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788643183.590327:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+4:25784:x1875527696905728:12345-0@lo:104: 00010000:00010000:1.0:1788643183.590343:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590438:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788643183.590444:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+4:25784:x1875527696905728:12345-0@lo:104: Request processed in 119us (13896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643183.590466:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788643183.590483:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788643183.590489:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+3:25784:x1875527696905856:12345-0@lo:104: 00010000:00010000:1.0:1788643183.590498:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590533:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788643183.590538:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+3:25784:x1875527696905856:12345-0@lo:104: Request processed in 50us (13836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643183.590544:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788643183.590570:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788643183.590575:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590582:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab000 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:1.0:1788643183.590586:0:22741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590594:0:22741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788643183.590601:0:22741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788643183.590606:0:22741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788643183.590650:0:22741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590666:0:22741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788643183.590690:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590698:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacfe7ab000/0x119ccc6e683c3f46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3f4d expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590711:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788643183.590714:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590720:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495e00 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:1.0:1788643183.590723:0:22741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590729:0:22741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788643183.590735:0:22741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788643183.590739:0:22741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788643183.590752:0:22741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590759:0:22741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788643183.590771:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590777:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c3eac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3eb3 expref: -99 pid: 24254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.590796:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643183.590798:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643183.590799:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643183.590821:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696906112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788643183.590856:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643183.590895:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788643183.590902:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da540a41-a984-4ac4-89dc-6d833e36a776:3643:1875527696906240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788643183.590923:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643183.590961:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696906112 00000100:00100000:1.0:1788643183.590965:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696906112 00010000:00010000:1.0:1788643183.590982:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c3f4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3f46 expref: 24 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643183.591008:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696906240 00000100:00100000:1.0:1788643183.591011:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696906240 00010000:00010000:1.0:1788643183.591021:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cabc7495c00/0x119ccc6e683c3eb3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3eac expref: 25 pid: 22746 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643183.591032:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788643183.591038:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+25:3645:x1875527696906112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788643183.591049:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643183.591053:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c3f4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3f46 expref: 25 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.591063:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c3f4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3f46 expref: 25 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.591080:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643183.591113:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+25:3645:x1875527696906112:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643183.591120:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788643183.591132:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788643183.591138:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+24:3643:x1875527696906240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788643183.591146:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643183.591150:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cabc7495c00/0x119ccc6e683c3eb3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3eac expref: 24 pid: 22746 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.591157:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cabc7495c00/0x119ccc6e683c3eb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3eac expref: 24 pid: 22746 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.591167:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643183.591191:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+24:3643:x1875527696906240:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643183.591196:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788643183.591226:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:da540a41-a984-4ac4-89dc-6d833e36a776:3645:1875527696906112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788643183.591246:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da540a41-a984-4ac4-89dc-6d833e36a776:3643:1875527696906240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788643183.591263:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788643183.597144:0:25784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cacf6d3dc00/0x119ccc6e683c3e66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x119ccc6e683c3e5f expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643183.597162:0:25784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cacf6d3dc00/0x119ccc6e683c3e66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x119ccc6e683c3e5f expref: 23 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643183.597176:0:25784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696906368:0@lo:104: 00000100:00100000:3.0:1788643183.597226:0:25784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643183.597352:0:25784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacfd73a840 going to sleep for 11 seconds 00010000:00010000:3.0:1788643183.600908:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacc0030600/0x119ccc6e683c41d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c91e expref: 12 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643183.600942:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696905472:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788643183.600978:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacff5e9400/0x119ccc6e683c4199 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8ae expref: 11 pid: 22746 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643183.600999:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696905600:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788643183.601013:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c3f4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3f46 expref: 23 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643183.601023:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696905728:0@lo:104: 00010000:00010000:3.0:1788643183.601032:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cabc7495c00/0x119ccc6e683c3eb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3eac expref: 22 pid: 22746 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643183.601039:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696905856:0@lo:104: 00000100:00100000:1.0:1788643183.603507:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696905984 00000100:00100000:1.0:1788643183.603520:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696905984 00000100:00100000:1.0:1788643183.603568:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696906368 00000100:00100000:1.0:1788643183.603572:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696906368 00000100:00100000:1.0:1788643183.603588:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788643183.603596:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+4:25784:x1875527696905984:12345-0@lo:104: 00010000:00010000:1.0:1788643183.603611:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.603971:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788643183.604064:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643183.604072:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.604079:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3d200 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:2.0:1788643183.604083:0:22741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.604103:0:22741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788643183.604110:0:22741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643183.604116:0:22741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788643183.604153:0:22741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.604160:0:22741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788643183.604179:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.604186:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d200/0x119ccc6e683c3e6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e74 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.604199:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643183.604200:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643183.604202:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643183.604221:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da540a41-a984-4ac4-89dc-6d833e36a776:3643:1875527696906496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788643183.604262:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643183.604305:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696906496 00000100:00100000:2.0:1788643183.604309:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696906496 00010000:00010000:2.0:1788643183.604327:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3e6d expref: 22 pid: 22744 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643183.604349:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788643183.604356:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc8e01450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+22:3643:x1875527696906496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788643183.604373:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788643183.604396:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3e6d expref: 22 pid: 22744 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.604408:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3e6d expref: 22 pid: 22744 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.604424:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788643183.604452:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc8e01450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da540a41-a984-4ac4-89dc-6d833e36a776+22:3643:x1875527696906496:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643183.604460:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788643183.604516:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da540a41-a984-4ac4-89dc-6d833e36a776:3643:1875527696906496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788643183.605250:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+4:25784:x1875527696905984:12345-0@lo:104: Request processed in 390us (21857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643183.605261:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788643183.605281:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788643183.605289:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+3:25784:x1875527696906368:12345-0@lo:104: 00010000:00010000:1.0:1788643183.605299:0:22735:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643183.605352:0:22735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788643183.605357:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:da540a41-a984-4ac4-89dc-6d833e36a776+3:25784:x1875527696906368:12345-0@lo:104: Request processed in 71us (8132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643183.605364:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788643183.605526:0:22740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788643183.605533:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605541:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacc2810600 already unused, calling callback (ffffffffc1320c20) 10000000:00010000:2.0:1788643183.605545:0:22740:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605553:0:22740:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788643183.605559:0:22740:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643183.605564:0:22740:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788643183.605596:0:22740:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605615:0:22740:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788643183.605633:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605651:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.118@tcp lock: ffff9cacc2810600/0x119ccc6e683c3e5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x119ccc6e683c3e66 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605677:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643183.605679:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788643183.605681:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643183.605693:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696906624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788643183.605724:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643183.605761:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696906624 00000100:00100000:2.0:1788643183.605767:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696906624 00010000:00010000:2.0:1788643183.605783:0:22738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cacf6d3dc00/0x119ccc6e683c3e66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3e5f expref: 22 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643183.605804:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788643183.605810:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da540a41-a984-4ac4-89dc-6d833e36a776+22:3644:x1875527696906624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788643183.605819:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788643183.605823:0:22738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cacf6d3dc00/0x119ccc6e683c3e66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x119ccc6e683c3e5f expref: 22 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605831:0:22738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cacf6d3dc00/0x119ccc6e683c3e66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x119ccc6e683c3e5f expref: 22 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605845:0:22738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605863:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605877:0:22738:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605885:0:22738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605892:0:22738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605899:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605905:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3d000 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643183.605909:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605916:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605925:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.605933:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788643183.605962:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da540a41-a984-4ac4-89dc-6d833e36a776+22:3644:x1875527696906624:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643183.605969:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788643183.606167:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:da540a41-a984-4ac4-89dc-6d833e36a776:3644:1875527696906624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788643183.607160:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacc2811a00/0x119ccc6e683c3e74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3e6d expref: 21 pid: 22744 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643183.607175:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696905984:0@lo:104: 00010000:00010000:0.0:1788643183.608613:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacf6d3dc00/0x119ccc6e683c3e66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x119ccc6e683c3e5f expref: 20 pid: 22745 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643183.608629:0:25784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25784:1875527696906368:0@lo:104: 00010000:00010000:0.0:1788643183.608869:0:25784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643183.608881:0:25784:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643183.608902:0:25784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643183.608907:0:25784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cacf6d3d000/0x119ccc6e683c4209 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643183.757681:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788643184.012150:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788643184.333353:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696906752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788643184.333439:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643184.335684:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696906752 00000100:00100000:0.0:1788643184.335697:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696906752 00000100:00100000:0.0:1788643184.335771:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788643184.335780:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696906752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788643184.335814:0:22757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788643184.335893:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875527696906752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643184.335900:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788643184.337829:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696906880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788643184.337891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643184.337985:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875527696906752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788643184.339650:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696906880 00000100:00100000:1.0:1788643184.339668:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696906880 00000100:00100000:1.0:1788643184.339734:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788643184.339744:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696906880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788643184.339776:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788643184.339853:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875527696906880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643184.339860:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788643184.340019:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875527696906880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788643184.746483:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643184.746582:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675829504 00000100:00100000:2.0:1788643184.746594:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675829504 00000100:00100000:2.0:1788643184.746672:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 147 00000100:00100000:2.0:1788643184.746682:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+11:18090:x1875527675829504:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788643184.746699:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643184.746719:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cabc7495000/0x119ccc6e683c4210 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c956 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643184.746747:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cabc7495000/0x119ccc6e683c4210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c956 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643184.746758:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cabc7495000/0x119ccc6e683c4210 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c956 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643184.746767:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7495000, rc 0) 00000100:00100000:2.0:1788643184.746829:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+12:18090:x1875527675829504:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 147us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643184.746836:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 147 00000100:00100000:2.0:1788643184.759851:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643184.760212:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675829632 00000100:00100000:3.0:1788643184.760221:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675829632 00000100:00100000:3.0:1788643184.760285:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 148 00000100:00100000:3.0:1788643184.760297:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+12:18090:x1875527675829632:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788643184.760474:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+12:18090:x1875527675829632:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 178us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643184.760482:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 148 00000100:00100000:3.0:1788643184.766662:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643184.766790:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675829760 00000100:00100000:0.0:1788643184.766799:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675829760 00000100:00100000:0.0:1788643184.766848:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 149 00000100:00100000:0.0:1788643184.766857:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+12:18090:x1875527675829760:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788643184.767010:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+12:18090:x1875527675829760:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 Request processed in 153us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643184.767018:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 149 00010000:00010000:2.0:1788643184.780632:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788643184.793114:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643184.793444:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675829888 00000100:00100000:2.0:1788643184.793452:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675829888 00000100:00100000:2.0:1788643184.793506:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 150 00000100:00100000:2.0:1788643184.793516:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+12:18090:x1875527675829888:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788643184.793531:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643184.793548:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cabc7494e00/0x119ccc6e683c4217 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c95d expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643184.793574:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cabc7494e00/0x119ccc6e683c4217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c95d expref: 13 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643184.793584:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cabc7494e00/0x119ccc6e683c4217 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c95d expref: 13 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643184.793593:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7494e00, rc 0) 00000100:00100000:2.0:1788643184.793665:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ce054bfd-e561-4af2-9937-f1d807468f29+13:18090:x1875527675829888:12345-192.168.206.18@tcp:101:ll_cfg_requeue.0 Request processed in 150us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643184.793673:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 150 00000100:00100000:2.0:1788643184.795835:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643184.795908:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675830016 00000100:00100000:3.0:1788643184.795915:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675830016 00000100:00100000:3.0:1788643184.795958:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 151 00000100:00100000:3.0:1788643184.795966:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc77d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+13:18090:x1875527675830016:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788643184.796106:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc77d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ce054bfd-e561-4af2-9937-f1d807468f29+13:18090:x1875527675830016:12345-192.168.206.18@tcp:501:ll_cfg_requeue.0 Request processed in 140us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643184.796115:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 151 00000100:00100000:3.0:1788643184.798895:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643184.798969:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675830144 00000100:00100000:0.0:1788643184.798986:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675830144 00000100:00100000:0.0:1788643184.799050:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 152 00000100:00100000:0.0:1788643184.799061:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+13:18090:x1875527675830144:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788643184.799193:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+13:18090:x1875527675830144:12345-192.168.206.18@tcp:503:ll_cfg_requeue.0 Request processed in 133us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643184.799201:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 152 00000100:00100000:0.0:1788643185.230339:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643185.230578:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675830272 00000100:00100000:3.0:1788643185.230589:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675830272 00000100:00100000:3.0:1788643185.230669:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00100000:3.0:1788643185.230679:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:18711:x1875527675830272:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788643185.230698:0:24283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643185.230717:0:24283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3da00/0x119ccc6e683c421e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c964 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.230783:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4225 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.230815:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4225 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.230827:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4225 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.230842:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c422c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.230848:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c422c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.230854:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c422c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.230931:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ce00/0x119ccc6e683c4233 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.230938:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ce00/0x119ccc6e683c4233 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.230945:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ce00/0x119ccc6e683c4233 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788643185.230972:0:24283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788643185.230976:0:24283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788643185.231009:0:24283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ce00/0x119ccc6e683c4233 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231019:0:24283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4225 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231035:0:24283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4225 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231042:0:24283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4225 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231047:0:24283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3ca00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:3.0:1788643185.231051:0:24283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4225 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231058:0:24283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4225 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231069:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558f00) 00010000:00010000:3.0:1788643185.231073:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788643185.231077:0:24283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4225 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231082:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4225 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231111:0:24283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c422c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231117:0:24283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c422c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231122:0:24283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c422c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231127:0:24283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3de00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:3.0:1788643185.231135:0:24283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c422c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231141:0:24283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c422c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231148:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9caccc446300) 00010000:00010000:3.0:1788643185.231150:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788643185.231153:0:24283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c422c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231158:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c422c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231188:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3da00/0x119ccc6e683c421e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c964 expref: 8 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231201:0:24283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ce00/0x119ccc6e683c4233 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c964 expref: 7 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.231208:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9caccc446500) 00010000:00010000:3.0:1788643185.231210:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788643185.231213:0:24283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacf6d3ce00, rc 0) 00000100:00100000:3.0:1788643185.231279:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+7:18711:x1875527675830272:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 601us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643185.231286:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 23 00000100:00080000:0.0:1788643185.232177:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788643185.242696:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643185.242898:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675830400 00000100:00100000:1.0:1788643185.242908:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675830400 00000100:00100000:1.0:1788643185.242968:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:1.0:1788643185.242978:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc999b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+7:18711:x1875527675830400:12345-192.168.206.18@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788643185.243057:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc999b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+7:18711:x1875527675830400:12345-192.168.206.18@tcp:900:lhsmtool_posix.0 Request processed in 81us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643185.243079:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:1.0:1788643185.253925:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643185.254021:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675830656 00000100:00100000:2.0:1788643185.254030:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675830656 00000100:00100000:2.0:1788643185.254102:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:2.0:1788643185.254113:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+7:18711:x1875527675830656:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788643185.254131:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643185.254151:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494200/0x119ccc6e683c423a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c96b expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254237:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c4241 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254251:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c4241 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254263:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c4241 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254308:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4248 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254317:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4248 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254324:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4248 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254677:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494c00/0x119ccc6e683c424f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254687:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494c00/0x119ccc6e683c424f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254694:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494c00/0x119ccc6e683c424f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788643185.254704:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788643185.254844:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c4241 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254860:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c4241 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254866:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c4241 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254872:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494600 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643185.254875:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c4241 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254883:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c4241 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254895:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9caccc446500) 00010000:00010000:2.0:1788643185.254897:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643185.254901:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c4241 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254907:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c4241 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254918:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4248 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254923:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4248 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254929:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4248 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254933:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494400 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643185.254943:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4248 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254949:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4248 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254957:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cacc66f9800) 00010000:00010000:2.0:1788643185.254960:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643185.254963:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4248 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.254969:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4248 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.255718:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494200/0x119ccc6e683c423a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c96b expref: 10 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.255735:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494c00/0x119ccc6e683c424f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c96b expref: 9 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.255742:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cacc66f9200) 00010000:00010000:2.0:1788643185.255744:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643185.255747:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7494c00, rc 0) 00000100:00100000:2.0:1788643185.255814:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+9:18711:x1875527675830656:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 1702us (1896us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788643185.255822:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:2.0:1788643185.265877:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643185.265995:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675830784 00000100:00100000:3.0:1788643185.266004:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675830784 00000100:00100000:3.0:1788643185.266100:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:3.0:1788643185.266113:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc9998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+9:18711:x1875527675830784:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788643185.266230:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc9998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+9:18711:x1875527675830784:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 Request processed in 120us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643185.266238:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:0.0:1788643185.274297:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643185.279327:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675830912 00000100:00100000:2.0:1788643185.279343:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675830912 00000100:00100000:2.0:1788643185.281590:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:2.0:1788643185.281620:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:18711:x1875527675830912:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788643185.283712:0:22753:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2039us 00000100:00080000:0.0:1788643185.286209:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788643185.319432:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643185.319804:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675831040 00000100:00100000:3.0:1788643185.319814:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675831040 00000100:00100000:3.0:1788643185.319870:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:3.0:1788643185.319881:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+9:18717:x1875527675831040:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:3.0:1788643185.319900:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643185.319919:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3da00/0x119ccc6e683c425d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c972 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.319992:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c4264 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320006:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c4264 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320017:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c4264 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320071:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c426b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320079:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c426b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320086:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c426b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320140:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c4264 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320148:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c4264 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320155:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c4264 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320160:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3de00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:3.0:1788643185.320164:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c4264 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320172:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c4264 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320185:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558f00) 00010000:00010000:3.0:1788643185.320188:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788643185.320193:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c4264 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320199:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c4264 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320210:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c426b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320216:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c426b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320222:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c426b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320233:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3ca00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:3.0:1788643185.320236:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c426b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320242:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c426b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320249:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9caccc446300) 00010000:00010000:3.0:1788643185.320252:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788643185.320254:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c426b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320260:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c426b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320495:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3da00/0x119ccc6e683c425d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c972 expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320505:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558f00) 00010000:00010000:3.0:1788643185.320507:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788643185.320511:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3da00/0x119ccc6e683c425d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c972 expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.320520:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacf6d3da00, rc 0) 00000100:00100000:3.0:1788643185.320831:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+9:18717:x1875527675831040:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 951us (1404us total) trans 0 rc 301/301 00000100:00100000:3.0:1788643185.320838:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 27 00000100:00100000:1.0:1788643185.325708:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643185.325809:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675831168 00000100:00100000:3.0:1788643185.325825:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675831168 00000100:00100000:3.0:1788643185.325907:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:3.0:1788643185.325918:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+9:18717:x1875527675831168:12345-192.168.206.18@tcp:700:lfs.0 00000100:00100000:3.0:1788643185.326023:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+9:18717:x1875527675831168:12345-192.168.206.18@tcp:700:lfs.0 Request processed in 106us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643185.326030:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:3.0:1788643185.327921:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643185.328011:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:18711:x1875527675830912:12345-192.168.206.18@tcp:59:lhsmtool_posix.0 Request processed in 46395us (53730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643185.328021:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:1.0:1788643185.328048:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675831424 00000100:00100000:1.0:1788643185.328056:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675831424 00000100:00100000:1.0:1788643185.328100:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:1.0:1788643185.328108:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+9:18717:x1875527675831424:12345-192.168.206.18@tcp:36:lfs.0 00010000:00010000:1.0:1788643185.328157:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643185.328183:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9a00/0x119ccc6e683c41c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c8df expref: 9 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.328200:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558f00) 00010000:00010000:1.0:1788643185.328206:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788643185.328261:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.328274:0:22753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c94f expref: 5 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.328282:0:22753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.328311:0:22753:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c94f expref: 5 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.328341:0:22753:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c94f expref: 5 pid: 24283 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643185.328355:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7dd9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22753:1875527696907008:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788643185.328438:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacc668e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788643185.336264:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643185.336313:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675831552 00000100:00100000:3.0:1788643185.336321:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675831552 00000100:00100000:1.0:1788643185.336359:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7dd9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22753:1875527696907008:192.168.206.18@tcp:104: 00010000:00010000:3.0:1788643185.336372:0:22739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c94f expref: 6 pid: 24283 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.336410:0:22753:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643185.336422:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:3.0:1788643185.336431:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:2401:x1875527675831552:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788643185.336445:0:22739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788643185.336452:0:22739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c94f expref: 6 pid: 24283 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.336464:0:22739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c94f expref: 6 pid: 24283 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.336487:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3d600/0x119ccc6e683c4202 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c94f expref: 6 pid: 24283 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.336500:0:22739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558f00) 00010000:00010000:3.0:1788643185.336505:0:22739:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.336528:0:22739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.336535:0:22739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.336562:0:22739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1788643185.336610:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788643185.336615:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2401:x1875527675831552:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 185us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643185.336623:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00010000:00010000:1.0:1788643185.336752:0:22753:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.336760:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.336783:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.336793:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.336801:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.340870:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.340891:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.340909:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788643185.340928:0:22753:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2b2ea66 reply state 000000009826cb84 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.340939:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.340946:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cabc6b23700) 00010000:00010000:1.0:1788643185.340949:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788643185.340952:0:22753:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788643185.340958:0:22753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788643185.340965:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.340971:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.341041:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.341047:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacda5b4c00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:1.0:1788643185.341051:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.341057:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.341068:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558f00) 00010000:00010000:1.0:1788643185.341070:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788643185.341080:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.341086:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4c00/0x119ccc6e683c4272 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788643185.341104:0:22753:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2b2ea66 reply state 000000009826cb84 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.341112:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.341118:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9cabc6b23800) 00010000:00010000:1.0:1788643185.341120:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788643185.341122:0:22753:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788643185.341221:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+10:18717:x1875527675831424:12345-192.168.206.18@tcp:36:lfs.0 Request processed in 13109us (13303us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788643185.341230:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 28 00000100:00100000:2.0:1788643185.409825:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643185.409965:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675831680 00000100:00100000:0.0:1788643185.409974:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675831680 00000100:00100000:0.0:1788643185.410183:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:0.0:1788643185.410193:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+10:18725:x1875527675831680:12345-192.168.206.18@tcp:101:lctl.0 00010000:00010000:0.0:1788643185.410214:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643185.410235:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c4287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c979 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.410293:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9e00/0x119ccc6e683c428e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.410306:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9e00/0x119ccc6e683c428e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.410316:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9e00/0x119ccc6e683c428e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788643185.410358:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788643185.410362:0:22752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788643185.411808:0:22752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9e00/0x119ccc6e683c428e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.411843:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c4287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c979 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.411862:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9e00/0x119ccc6e683c428e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c979 expref: 11 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.411871:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558800) 00010000:00010000:0.0:1788643185.411874:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788643185.411877:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacff5e9e00, rc 0) 00000100:00100000:0.0:1788643185.411940:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+11:18725:x1875527675831680:12345-192.168.206.18@tcp:101:lctl.0 Request processed in 1749us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643185.411948:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 29 00000100:00100000:1.0:1788643185.447302:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643185.447408:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675831808 00000100:00100000:2.0:1788643185.447418:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675831808 00000100:00100000:2.0:1788643185.447475:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:2.0:1788643185.447485:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:18726:x1875527675831808:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788643185.447503:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643185.447522:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4295 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c980 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.447585:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c429c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.447599:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c429c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.447610:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c429c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788643185.447831:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788643185.447835:0:22754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788643185.447857:0:22754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c429c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.447880:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4295 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c980 expref: 7 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.447916:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494600/0x119ccc6e683c429c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c980 expref: 6 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.447924:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558800) 00010000:00010000:2.0:1788643185.447928:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788643185.447931:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7494600, rc 0) 00000100:00100000:2.0:1788643185.447998:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:18726:x1875527675831808:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 515us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643185.448005:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 30 00000100:00100000:1.0:1788643185.449952:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643185.450068:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675831936 00000100:00100000:2.0:1788643185.450076:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675831936 00000100:00100000:2.0:1788643185.450255:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:2.0:1788643185.450266:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+6:18726:x1875527675831936:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788643185.450283:0:24283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643185.450302:0:24283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c987 expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450360:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c42aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450445:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c42aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450457:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c42aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450470:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450485:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450492:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450565:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c42b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450574:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c42b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450580:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c42b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788643185.450613:0:24283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788643185.450616:0:24283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788643185.450760:0:24283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c42b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450773:0:24283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c42aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450780:0:24283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c42aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450787:0:24283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c42aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450792:0:24283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494800 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643185.450797:0:24283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c42aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450812:0:24283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c42aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450824:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558800) 00010000:00010000:2.0:1788643185.450827:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643185.450831:0:24283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c42aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450838:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c42aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450851:0:24283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450857:0:24283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450864:0:24283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450869:0:24283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495e00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643185.450871:0:24283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450876:0:24283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450882:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9cabc6b23800) 00010000:00010000:2.0:1788643185.450885:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643185.450888:0:24283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450904:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450931:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c987 expref: 8 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450944:0:24283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c42b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c987 expref: 7 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.450951:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cabc6b23700) 00010000:00010000:2.0:1788643185.450953:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788643185.450955:0:24283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7495c00, rc 0) 00000100:00100000:2.0:1788643185.451275:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c19b19f4-27dd-4e30-b734-f16bf35fa52d+7:18726:x1875527675831936:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 1010us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643185.451283:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 31 00000100:00100000:3.0:1788643185.454478:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643185.454693:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675832064 00000100:00100000:1.0:1788643185.454701:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675832064 00000100:00100000:1.0:1788643185.454764:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:1.0:1788643185.454774:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:18726:x1875527675832064:12345-192.168.206.18@tcp:900:lfs.0 00000100:00100000:1.0:1788643185.454840:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:18726:x1875527675832064:12345-192.168.206.18@tcp:900:lfs.0 Request processed in 68us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643185.454847:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00080000:0.0:1788643185.454974:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788643185.458222:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643185.458299:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675832320 00000100:00100000:2.0:1788643185.458308:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675832320 00000100:00100000:2.0:1788643185.458363:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:2.0:1788643185.458512:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+7:18726:x1875527675832320:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788643185.458530:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643185.458548:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495a00/0x119ccc6e683c42bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c98e expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788643185.458643:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788643185.458741:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495a00/0x119ccc6e683c42bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c98e expref: 9 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.458769:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558800) 00010000:00010000:2.0:1788643185.458772:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788643185.458777:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495a00/0x119ccc6e683c42bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c98e expref: 9 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.458790:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7495a00, rc 0) 00000100:00100000:2.0:1788643185.458847:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+8:18726:x1875527675832320:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 341us (634us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788643185.458855:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 32 00000100:00100000:1.0:1788643185.462210:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643185.462348:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675832576 00000100:00100000:0.0:1788643185.462357:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675832576 00000100:00100000:0.0:1788643185.462437:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:0.0:1788643185.462446:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+8:18726:x1875527675832576:12345-192.168.206.18@tcp:36:lfs.0 00010000:00010000:0.0:1788643185.462496:0:22752:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788643185.462520:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c42b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c987 expref: 8 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.462539:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cabc6b23700) 00010000:00010000:0.0:1788643185.462544:0:22752:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788643185.462564:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.462591:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.462601:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788643185.462799:0:22752:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d42af229 reply state 00000000e39adba3 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.462811:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.462818:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cabc6b23700) 00010000:00010000:0.0:1788643185.462821:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788643185.462823:0:22752:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788643185.462829:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788643185.462903:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+9:18726:x1875527675832576:12345-192.168.206.18@tcp:36:lfs.0 Request processed in 457us (700us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788643185.462910:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 33 00000100:00100000:3.0:1788643185.465692:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643185.465814:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675832832 00000100:00100000:2.0:1788643185.465823:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675832832 00000100:00100000:2.0:1788643185.465867:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:2.0:1788643185.465876:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+9:18726:x1875527675832832:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:2.0:1788643185.466064:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+10:18726:x1875527675832832:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 189us (379us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788643185.466072:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:1.0:1788643185.476360:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643185.476536:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675833088 00000100:00100000:2.0:1788643185.476546:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675833088 00000100:00100000:2.0:1788643185.476600:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:2.0:1788643185.476611:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+10:18726:x1875527675833088:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788643185.476640:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643185.476665:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495a00/0x119ccc6e683c42d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c995 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.476728:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.476748:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.476759:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.476769:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.476776:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.476782:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788643185.476873:0:22753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788643185.476936:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.476943:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.476949:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.476955:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495400 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643185.476959:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.476966:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.476986:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558800) 00010000:00010000:2.0:1788643185.476989:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643185.476994:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.477000:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495400/0x119ccc6e683c42db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.477012:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.477017:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.477022:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.477027:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495e00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643185.477029:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.477034:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.477041:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9cabc6b23800) 00010000:00010000:2.0:1788643185.477043:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643185.477046:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.477051:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495e00/0x119ccc6e683c42e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.477089:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495a00/0x119ccc6e683c42d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c995 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.477099:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558800) 00010000:00010000:2.0:1788643185.477102:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788643185.477105:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495a00/0x119ccc6e683c42d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c995 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.477114:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7495a00, rc 0) 00000100:00100000:2.0:1788643185.477219:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+11:18726:x1875527675833088:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 609us (867us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788643185.477226:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 34 00000100:00100000:1.0:1788643185.481896:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 10000000:01000000:1.0:1788643185.483823:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788643185.483830:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cacf5764800 from 13 10000000:01000000:1.0:1788643185.483835:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788643185.483883:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacda5b4800/0x119ccc6e683c42f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.483895:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacda5b4800/0x119ccc6e683c42f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643185.483906:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacda5b4800/0x119ccc6e683c42f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643185.483933:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788643185.483994:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643185.484036:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacd11ee240 going to sleep for 11 seconds 00000100:00100000:2.0:1788643185.484095:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696907136 00000100:00100000:2.0:1788643185.484103:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696907136 00000100:00100000:2.0:1788643185.484157:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788643185.484167:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+20:22749:x1875527696907136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788643185.484180:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643185.484192:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c42f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c42f0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.484212:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c42f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c42f0 expref: 21 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.484222:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cabc7495a00/0x119ccc6e683c42f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c42f0 expref: 21 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.484230:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7495a00, rc 0) 00000100:00100000:2.0:1788643185.484298:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:22749:x1875527696907136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643185.484305:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788643185.484426:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643185.484439:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacda5b4800/0x119ccc6e683c42f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c42f7 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.484448:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacda5b4800/0x119ccc6e683c42f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c42f7 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643185.484505:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788643185.484534:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643185.484552:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacfd73a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643185.484680:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696907264 00000100:00100000:1.0:1788643185.484685:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696907264 00000100:00100000:1.0:1788643185.484715:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788643185.484721:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+21:22749:x1875527696907264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788643185.484814:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+21:22749:x1875527696907264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643185.484821:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788643185.484988:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788643185.485025:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788643185.485055:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643185.485074:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacfd73a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643185.485238:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696907392 00000100:00100000:1.0:1788643185.485242:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696907392 00000100:00100000:1.0:1788643185.485268:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788643185.485274:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+21:22749:x1875527696907392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788643185.485350:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+21:22749:x1875527696907392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643185.485365:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788643185.485486:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788643185.485879:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675833216 00000100:00100000:0.0:1788643185.485885:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675833216 00000100:00100000:0.0:1788643185.485932:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 35 00000100:00100000:0.0:1788643185.485941:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+11:18726:x1875527675833216:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788643185.485959:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643185.485987:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9800/0x119ccc6e683c42fe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c99c expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.486069:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.486265:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.486289:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788643185.486317:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788643185.486320:0:22752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788643185.486338:0:22752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.486367:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9800/0x119ccc6e683c42fe lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c99c expref: 13 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.486543:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c99c expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.486554:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cabc6b23700) 00010000:00010000:0.0:1788643185.486557:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788643185.486560:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacff5e8400, rc 0) 00000100:00100000:0.0:1788643185.486685:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+12:18726:x1875527675833216:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 745us (4797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643185.486692:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 35 00000040:00080000:0.0:1788643185.488912:0:25798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788643185.490577:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788643185.490613:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788643185.490626:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacda5b4800/0x119ccc6e683c42f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c42f7 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.490659:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacda5b4800/0x119ccc6e683c42f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c42f7 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788643185.490670:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788643185.490672:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cacf7e56800 from 13 10000000:01000000:2.0:1788643185.490675:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788643185.490710:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c430c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.490718:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c430c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.490728:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c430c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643185.490751:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788643185.490814:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643185.490855:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacda1cfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788643185.491017:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696907520 00000100:00100000:3.0:1788643185.491025:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696907520 00000100:00100000:3.0:1788643185.491076:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788643185.491085:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+21:22749:x1875527696907520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643185.491267:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643185.491281:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacf6d3da00/0x119ccc6e683c4313 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c430c expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.491304:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacf6d3da00/0x119ccc6e683c4313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c430c expref: 22 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.491314:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacf6d3da00/0x119ccc6e683c4313 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c430c expref: 22 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.491322:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacf6d3da00, rc 0) 00000100:00100000:3.0:1788643185.491378:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+22:22749:x1875527696907520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 282us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643185.491609:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788643185.491828:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788643185.491843:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c430c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4313 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.491869:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c430c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c4313 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643185.491932:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788643185.491959:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643185.492078:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacda1cfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788643185.496038:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696907648 00000100:00100000:3.0:1788643185.496053:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696907648 00000100:00100000:3.0:1788643185.496294:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788643185.496306:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+22:22749:x1875527696907648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788643185.496709:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+22:22749:x1875527696907648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 405us (4746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643185.496718:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788643185.497544:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643185.497624:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675833344 00000100:00100000:1.0:1788643185.497631:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675833344 00000100:00100000:1.0:1788643185.497691:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:1.0:1788643185.497700:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+12:18726:x1875527675833344:12345-192.168.206.18@tcp:37:lfs.0 00000100:00100000:1.0:1788643185.501578:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+12:18726:x1875527675833344:12345-192.168.206.18@tcp:37:lfs.0 Request processed in 3869us (4029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643185.501591:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 3 00000100:00100000:2.0:1788643185.502791:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788643185.502849:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788643185.502914:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643185.502952:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacda1cfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788643185.503183:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696907776 00000100:00100000:3.0:1788643185.503190:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696907776 00000100:00100000:3.0:1788643185.503247:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788643185.503256:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+22:22749:x1875527696907776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788643185.503406:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+22:22749:x1875527696907776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643185.503413:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788643185.503611:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788643185.504681:0:25799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788643185.505032:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788643185.505052:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788643185.505062:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c430c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4313 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.505084:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cabc7495e00/0x119ccc6e683c430c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4313 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788643185.505094:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788643185.505097:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cabc783a000 from 13 10000000:01000000:0.0:1788643185.505100:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788643185.505129:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacff5e8200/0x119ccc6e683c431a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.505137:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacff5e8200/0x119ccc6e683c431a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.505147:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacff5e8200/0x119ccc6e683c431a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643185.505167:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788643185.505216:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643185.505257:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cace7689900 going to sleep for 11 seconds 00000100:00100000:2.0:1788643185.505536:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696907904 00000100:00100000:2.0:1788643185.505543:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696907904 00000100:00100000:2.0:1788643185.505590:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788643185.505598:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+22:22749:x1875527696907904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788643185.505609:0:22746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643185.505621:0:22746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cabc7495400/0x119ccc6e683c4321 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c431a expref: -99 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.505738:0:22746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cabc7495400/0x119ccc6e683c4321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c431a expref: 23 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.505750:0:22746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cabc7495400/0x119ccc6e683c4321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c431a expref: 23 pid: 22746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.505769:0:22746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7495400, rc 0) 00000100:00100000:2.0:1788643185.505963:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+23:22749:x1875527696907904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 366us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643185.505970:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788643185.507007:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696907904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788643185.507027:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacff5e8200/0x119ccc6e683c431a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4321 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.507038:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacff5e8200/0x119ccc6e683c431a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c4321 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643185.507113:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696908032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788643185.507151:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643185.507185:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cace7689900 going to sleep for 11 seconds 00000100:00100000:1.0:1788643185.507335:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696908032 00000100:00100000:1.0:1788643185.507341:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696908032 00000100:00100000:1.0:1788643185.507408:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788643185.507417:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+23:22749:x1875527696908032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788643185.507762:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da540a41-a984-4ac4-89dc-6d833e36a776+23:22749:x1875527696908032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643185.507770:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788643185.507937:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696908032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788643185.507967:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696908160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788643185.508071:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643185.508185:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc1ca0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788643185.509364:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696908160 00000100:00100000:2.0:1788643185.509597:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696908160 00000100:00100000:2.0:1788643185.510112:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788643185.510123:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+23:22749:x1875527696908160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788643185.510275:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+23:22749:x1875527696908160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643185.510284:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788643185.510989:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696908160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788643185.513815:0:25800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788643185.513987:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788643185.514011:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788643185.514026:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacff5e8200/0x119ccc6e683c431a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4321 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.514041:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacff5e8200/0x119ccc6e683c431a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c4321 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788643185.514051:0:22749:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788643185.514054:0:22749:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cabc94a4800 from 13 10000000:01000000:3.0:1788643185.514057:0:22749:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788643185.514107:0:22749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d600/0x119ccc6e683c4328 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.514114:0:22749:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d600/0x119ccc6e683c4328 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.514124:0:22749:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d600/0x119ccc6e683c4328 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643185.514160:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696908288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788643185.514220:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643185.514947:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc1ca0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788643185.516540:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643185.519081:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696908288 00000100:00100000:0.0:1788643185.519106:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696908288 00000100:00100000:0.0:1788643185.519163:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788643185.519172:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+23:22749:x1875527696908288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788643185.519188:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643185.519204:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cacff5e9a00/0x119ccc6e683c432f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x119ccc6e683c4328 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.519230:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cacff5e9a00/0x119ccc6e683c432f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x119ccc6e683c4328 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.519241:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cacff5e9a00/0x119ccc6e683c432f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x119ccc6e683c4328 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.519250:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacff5e9a00, rc 0) 00000100:00100000:0.0:1788643185.519333:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+24:22749:x1875527696908288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (5112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643185.519340:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788643185.519407:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675833600 00000100:00100000:0.0:1788643185.519411:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675833600 00000100:00100000:0.0:1788643185.519441:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:0.0:1788643185.519447:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8987c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+12:18726:x1875527675833600:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:0.0:1788643185.519611:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8987c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+13:18726:x1875527675833600:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 162us (3076us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788643185.519617:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 4 00000100:00100000:3.0:1788643185.519954:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696908288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788643185.519971:0:22749:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d600/0x119ccc6e683c4328 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c432f expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.519992:0:22749:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d600/0x119ccc6e683c4328 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x119ccc6e683c432f expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643185.520061:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696908416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788643185.520103:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643185.520130:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc1ca0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788643185.520868:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696908416 00000100:00100000:0.0:1788643185.520874:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696908416 00000100:00100000:0.0:1788643185.520910:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788643185.520916:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+24:22749:x1875527696908416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788643185.521082:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+24:22749:x1875527696908416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643185.521150:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788643185.521282:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696908416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788643185.521312:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696908544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788643185.521348:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643185.521405:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cabc1ca0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788643185.521862:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696908544 00000100:00100000:2.0:1788643185.521867:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696908544 00000100:00100000:2.0:1788643185.521896:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788643185.521902:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+24:22749:x1875527696908544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788643185.523698:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da540a41-a984-4ac4-89dc-6d833e36a776+24:22749:x1875527696908544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1788us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643185.523710:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788643185.526164:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc6bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:da540a41-a984-4ac4-89dc-6d833e36a776:22749:1875527696908544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788643185.527956:0:25801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788643185.532260:0:22749:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788643185.532286:0:22749:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788643185.532296:0:22749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d600/0x119ccc6e683c4328 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c432f expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.532309:0:22749:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.118@tcp lock: ffff9cacf6d3d600/0x119ccc6e683c4328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x119ccc6e683c432f expref: -99 pid: 22749 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643185.600909:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643185.601533:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675833728 00000100:00100000:2.0:1788643185.601545:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675833728 00000100:00100000:2.0:1788643185.601605:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:2.0:1788643185.601616:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+11:18733:x1875527675833728:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788643185.601637:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643185.601669:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c4336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9a3 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601751:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c433d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601766:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c433d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601777:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c433d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601790:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4344 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601798:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601804:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601879:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494200/0x119ccc6e683c434b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601888:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494200/0x119ccc6e683c434b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601895:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494200/0x119ccc6e683c434b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788643185.601928:0:22753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788643185.601932:0:22753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788643185.601966:0:22753:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494200/0x119ccc6e683c434b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601987:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c433d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601992:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c433d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.601999:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c433d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602004:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7494400 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643185.602008:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c433d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602014:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c433d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602026:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558800) 00010000:00010000:2.0:1788643185.602029:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643185.602033:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c433d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602038:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c433d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602050:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4344 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602056:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4344 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602061:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4344 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602071:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495c00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643185.602074:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4344 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602079:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4344 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602087:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9cabc6b23800) 00010000:00010000:2.0:1788643185.602105:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643185.602108:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4344 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602114:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4344 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602139:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c4336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9a3 expref: 13 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602151:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494200/0x119ccc6e683c434b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9a3 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.602157:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cabc6b23700) 00010000:00010000:2.0:1788643185.602160:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788643185.602162:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7494200, rc 0) 00000100:00100000:2.0:1788643185.602222:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+12:18733:x1875527675833728:12345-192.168.206.18@tcp:101:bash.0 Request processed in 607us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643185.602228:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 36 00000100:00100000:3.0:1788643185.622137:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643185.624070:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675833856 00000100:00100000:1.0:1788643185.624084:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675833856 00000100:00100000:1.0:1788643185.624155:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:1.0:1788643185.624164:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:18733:x1875527675833856:12345-192.168.206.18@tcp:900:bash.0 00000100:00100000:1.0:1788643185.624247:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:18733:x1875527675833856:12345-192.168.206.18@tcp:900:bash.0 Request processed in 84us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643185.624255:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:3.0:1788643185.627082:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643185.627421:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675834112 00000100:00100000:2.0:1788643185.627443:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675834112 00000100:00100000:2.0:1788643185.627503:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 37 00000100:00100000:2.0:1788643185.627513:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+12:18733:x1875527675834112:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:2.0:1788643185.627532:0:24283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643185.627552:0:24283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c4352 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9aa expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.627664:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.627679:0:24283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c99c expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.627688:0:24283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.627718:0:24283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c99c expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.627732:0:24283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c99c expref: 12 pid: 22752 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643185.627744:0:24283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24283:1875527696908672:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788643185.627815:0:24283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacda463780 going to sleep for 11 seconds 00000100:00100000:2.0:1788643185.629624:0:24283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7ece300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24283:1875527696908672:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788643185.629661:0:24283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643185.629695:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643185.629721:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675834240 00000100:00100000:2.0:1788643185.629728:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675834240 00010000:00010000:2.0:1788643185.629756:0:22738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c99c expref: 13 pid: 22752 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643185.629795:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:2.0:1788643185.629803:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+13:2401:x1875527675834240:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788643185.629816:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788643185.629823:0:22738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c99c expref: 13 pid: 22752 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.629834:0:22738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c99c expref: 13 pid: 22752 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.629854:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8400/0x119ccc6e683c4305 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c99c expref: 13 pid: 22752 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.629869:0:22738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cabc6b23700) 00010000:00010000:2.0:1788643185.629873:0:22738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.629882:0:22738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.629890:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.629916:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788643185.629979:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c19b19f4-27dd-4e30-b734-f16bf35fa52d+12:2401:x1875527675834240:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 170us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643185.629987:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00010000:00010000:3.0:1788643185.630371:0:24283:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.630420:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.630495:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.630505:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.630512:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631052:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4367 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631063:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4367 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631070:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4367 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788643185.631079:0:24283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788643185.631529:0:24283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631539:0:24283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631546:0:24283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631552:0:24283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495c00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643185.631556:0:24283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631563:0:24283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631573:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cabc6b23700) 00010000:00010000:2.0:1788643185.631577:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643185.631580:0:24283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631594:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4359 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788643185.631607:0:24283:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f026810d reply state 00000000a83ff0e3 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631618:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631625:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9caccc446300) 00010000:00010000:2.0:1788643185.631627:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788643185.631630:0:24283:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788643185.631672:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c4352 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9aa expref: 15 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631685:0:24283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4367 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9aa expref: 14 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.631691:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:2.0:1788643185.631693:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788643185.631695:0:24283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7494400, rc 0) 00000100:00100000:2.0:1788643185.631794:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+15:18733:x1875527675834112:12345-192.168.206.18@tcp:101:bash.0 Request processed in 4282us (4718us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788643185.631802:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 37 00000100:00100000:3.0:1788643185.652466:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643185.652530:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675834368 00000100:00100000:3.0:1788643185.652540:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675834368 00000100:00100000:3.0:1788643185.652594:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:3.0:1788643185.652604:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+15:18733:x1875527675834368:12345-192.168.206.18@tcp:101:bash.0 00010000:00010000:3.0:1788643185.652630:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643185.652665:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4375 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9b1 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.652727:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.652741:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.652752:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788643185.652809:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788643185.652813:0:22754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788643185.652831:0:22754:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.652840:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.652869:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c4375 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9b1 expref: 17 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.652886:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9b1 expref: 16 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643185.652894:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:3.0:1788643185.652897:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788643185.652900:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacf6d3de00, rc 0) 00000100:00100000:3.0:1788643185.653160:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+16:18733:x1875527675834368:12345-192.168.206.18@tcp:101:bash.0 Request processed in 556us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643185.653167:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 38 00000100:00100000:3.0:1788643185.660693:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643185.661746:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675834624 00000100:00100000:1.0:1788643185.661757:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675834624 00000100:00100000:1.0:1788643185.661832:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:1.0:1788643185.661842:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+16:18733:x1875527675834624:12345-192.168.206.18@tcp:35:bash.0 00000100:00100000:1.0:1788643185.662131:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+17:18733:x1875527675834624:12345-192.168.206.18@tcp:35:bash.0 Request processed in 289us (1445us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788643185.662139:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 5 00000100:00100000:1.0:1788643185.769874:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643185.769984:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675834880 00000100:00100000:0.0:1788643185.769993:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675834880 00000100:00100000:0.0:1788643185.770052:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 39 00000100:00100000:0.0:1788643185.770063:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+17:18743:x1875527675834880:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:0.0:1788643185.770086:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643185.770105:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c4383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9b8 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788643185.770194:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788643185.770300:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c4383 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9b8 expref: 19 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.770314:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cacda558800) 00010000:00010000:0.0:1788643185.770317:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788643185.770335:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c4383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9b8 expref: 19 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.770349:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacff5e9c00, rc 0) 00000100:00100000:0.0:1788643185.770468:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+18:18743:x1875527675834880:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 407us (602us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788643185.770476:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 39 00000100:00100000:3.0:1788643185.776355:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643185.776824:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675835136 00000100:00100000:1.0:1788643185.776833:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675835136 00000100:00100000:1.0:1788643185.776893:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 6 00000100:00100000:1.0:1788643185.776903:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+18:18743:x1875527675835136:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:1.0:1788643185.777130:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+19:18743:x1875527675835136:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 227us (780us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788643185.777138:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 6 00010000:00010000:2.0:1788643185.804543:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643185.826175:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643185.826269:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675835392 00000100:00100000:2.0:1788643185.826290:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675835392 00000100:00100000:2.0:1788643185.826348:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:2.0:1788643185.826357:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+19:18746:x1875527675835392:12345-192.168.206.18@tcp:101:lfs.0 00010000:00010000:2.0:1788643185.826420:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643185.826440:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c4391 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9bf expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.826534:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4398 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.826549:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4398 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.826737:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4398 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788643185.826748:0:22753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788643185.826844:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494800/0x119ccc6e683c4391 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9bf expref: 22 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.826862:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4398 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9bf expref: 21 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.826870:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:2.0:1788643185.826873:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788643185.826876:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7495c00, rc 0) 00000100:00100000:2.0:1788643185.826981:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+21:18746:x1875527675835392:12345-192.168.206.18@tcp:101:lfs.0 Request processed in 616us (806us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788643185.826990:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 40 00000100:00100000:3.0:1788643185.831452:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643185.831493:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643185.831568:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675835520 00000100:00100000:0.0:1788643185.831577:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675835520 00000100:00100000:2.0:1788643185.831818:0:23507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675835648 00000100:00100000:2.0:1788643185.831822:0:23507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675835648 00000100:00100000:2.0:1788643185.831858:0:23507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:2.0:1788643185.831880:0:23507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+22:2402:x1875527675835648:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788643185.831894:0:23507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788643185.831917:0:23507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c4398 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9bf expref: 22 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643185.831935:0:23507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:2.0:1788643185.831941:0:23507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788643185.832007:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:0.0:1788643185.832017:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+21:18746:x1875527675835520:12345-192.168.206.18@tcp:54:lfs.0 00010000:00010000:0.0:1788643185.832068:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43a6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.832080:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.832090:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.832122:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43a6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.832129:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43a6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.832135:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43a6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.832140:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e9c00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:0.0:1788643185.832144:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43a6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.832159:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43a6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.832169:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:0.0:1788643185.832172:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788643185.832176:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43a6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643185.832183:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43a6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643185.832822:0:23507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+21:2402:x1875527675835648:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 941us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643185.832831:0:23507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:0.0:1788643185.833008:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+20:18746:x1875527675835520:12345-192.168.206.18@tcp:54:lfs.0 Request processed in 992us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643185.833015:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 41 00000100:00100000:3.0:1788643185.835747:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643185.835842:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675835904 00000100:00100000:1.0:1788643185.835852:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675835904 00000100:00100000:1.0:1788643185.835911:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 7 00000100:00100000:1.0:1788643185.835921:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+20:18746:x1875527675835904:12345-192.168.206.18@tcp:35:lfs.0 00000100:00100000:1.0:1788643185.836123:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+21:18746:x1875527675835904:12345-192.168.206.18@tcp:35:lfs.0 Request processed in 203us (385us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788643185.836131:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 7 00000040:00080000:0.0:1788643186.060021:0:23506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788643186.124883:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788643186.128515:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643186.128687:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675836160 00000100:00100000:3.0:1788643186.128695:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675836160 00000100:00100000:3.0:1788643186.128748:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:3.0:1788643186.128768:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+21:18777:x1875527675836160:12345-192.168.206.18@tcp:101:cat.0 00010000:00010000:3.0:1788643186.128789:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643186.128855:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c43ad lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9c6 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.129064:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3cc00/0x119ccc6e683c43b4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.129078:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3cc00/0x119ccc6e683c43b4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.129088:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3cc00/0x119ccc6e683c43b4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788643186.129098:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788643186.129213:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c43ad lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9c6 expref: 24 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.129231:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3cc00/0x119ccc6e683c43b4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9c6 expref: 23 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.129243:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:3.0:1788643186.129246:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788643186.129249:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacf6d3cc00, rc 0) 00000100:00100000:3.0:1788643186.129571:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+23:18777:x1875527675836160:12345-192.168.206.18@tcp:101:cat.0 Request processed in 803us (1063us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1788643186.129577:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 42 00000100:00100000:2.0:1788643186.133487:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643186.133534:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643186.133621:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675836416 00000100:00100000:1.0:1788643186.133641:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675836416 00000100:00100000:1.0:1788643186.133708:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:1.0:1788643186.133729:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+23:18777:x1875527675836416:12345-192.168.206.18@tcp:35:cat.0 00000100:00100000:1.0:1788643186.133998:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+24:18777:x1875527675836416:12345-192.168.206.18@tcp:35:cat.0 Request processed in 269us (517us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788643186.134005:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 8 00000100:00100000:3.0:1788643186.134499:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675836544 00000100:00100000:3.0:1788643186.134506:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675836544 00000100:00100000:3.0:1788643186.134561:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:3.0:1788643186.134569:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+24:2402:x1875527675836544:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788643186.134580:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788643186.134601:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3cc00/0x119ccc6e683c43b4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9c6 expref: 24 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.134618:0:22738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:3.0:1788643186.134623:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788643186.134671:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+23:2402:x1875527675836544:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 102us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643186.134678:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:2.0:1788643186.210296:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643186.210440:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675836800 00000100:00100000:0.0:1788643186.210449:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675836800 00000100:00100000:0.0:1788643186.210512:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:0.0:1788643186.210520:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+23:18783:x1875527675836800:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:0.0:1788643186.210541:0:24283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788643186.210560:0:24283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43c2 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9cd expref: -99 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.210678:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9600/0x119ccc6e683c43c9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.210693:0:24283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4367 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9aa expref: 24 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.210718:0:24283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9b1 expref: 24 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.210726:0:24283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9600/0x119ccc6e683c43c9 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.210755:0:24283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9b1 expref: 24 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.210768:0:24283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9b1 expref: 24 pid: 22754 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643186.210782:0:24283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24283:1875527696908800:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788643186.210876:0:24283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4367 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9aa expref: 24 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.210884:0:24283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4367 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9aa expref: 24 pid: 24283 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643186.210893:0:24283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e33100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24283:1875527696908928:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788643186.210927:0:24283:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cace76896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788643186.213756:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643186.213860:0:23507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675836928 00000100:00100000:1.0:1788643186.213868:0:23507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675836928 00010000:00010000:1.0:1788643186.213903:0:23507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9b1 expref: 25 pid: 22754 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643186.213950:0:23507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:1.0:1788643186.213959:0:23507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+25:2402:x1875527675836928:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788643186.213971:0:23507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643186.213984:0:23507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9b1 expref: 25 pid: 22754 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643186.213996:0:23507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9b1 expref: 25 pid: 22754 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643186.214016:0:23507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:1.0:1788643186.214021:0:23507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9600/0x119ccc6e683c43c9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643186.214028:0:23507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9600/0x119ccc6e683c43c9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643186.214035:0:23507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643186.214087:0:23507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+25:2402:x1875527675836928:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 128us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643186.214108:0:23507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00010000:00010000:0.0:1788643186.215653:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3de00/0x119ccc6e683c437c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9b1 expref: 24 pid: 22754 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643186.215675:0:24283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24283:1875527696908800:192.168.206.18@tcp:104: 00000100:00100000:0.0:1788643186.215705:0:24283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e33100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24283:1875527696908928:192.168.206.18@tcp:104: 00010000:00010000:0.0:1788643186.215728:0:24283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9600/0x119ccc6e683c43c9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643186.216967:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643186.217047:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675837056 00000100:00100000:3.0:1788643186.217054:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675837056 00010000:00010000:3.0:1788643186.217086:0:22738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4367 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9aa expref: 24 pid: 24283 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643186.217120:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:3.0:1788643186.217130:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacc8e00050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+24:2401:x1875527675837056:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788643186.217143:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788643186.217148:0:22738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4367 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9aa expref: 24 pid: 24283 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.217159:0:22738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4367 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9aa expref: 24 pid: 24283 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.217177:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4367 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9aa expref: 24 pid: 24283 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.217204:0:22738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:3.0:1788643186.217209:0:22738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9600/0x119ccc6e683c43c9 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.217216:0:22738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9600/0x119ccc6e683c43c9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.217223:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9600/0x119ccc6e683c43c9 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643186.217254:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788643186.217312:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacc8e00050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+23:2401:x1875527675837056:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 184us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643186.217319:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00010000:00010000:0.0:1788643186.217456:0:24283:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9600/0x119ccc6e683c43c9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.217463:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9600/0x119ccc6e683c43c9 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788643186.217479:0:24283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788643186.217616:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43c2 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9cd expref: 24 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.217642:0:24283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9600/0x119ccc6e683c43c9 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9cd expref: 23 pid: 24283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.217659:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:0.0:1788643186.217662:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788643186.217665:0:24283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacff5e9600, rc 0) 00000100:00100000:0.0:1788643186.217690:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+23:18783:x1875527675836800:12345-192.168.206.18@tcp:101:dd.0 Request processed in 7170us (7420us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788643186.217697:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 43 00000100:00100000:3.0:1788643186.222363:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643186.222591:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675837184 00000100:00100000:2.0:1788643186.222600:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675837184 00000100:00100000:2.0:1788643186.222674:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:2.0:1788643186.222684:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+23:18783:x1875527675837184:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:2.0:1788643186.222708:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643186.222726:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c43d7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9d4 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.222759:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa600/0x119ccc6e683c43de lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.222771:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa600/0x119ccc6e683c43de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.222796:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa600/0x119ccc6e683c43de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.222895:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c43d7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9d4 expref: 25 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.222912:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa600/0x119ccc6e683c43de lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9d4 expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.222937:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:2.0:1788643186.222940:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788643186.222943:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacfe7aa600, rc 0) 00000100:00100000:2.0:1788643186.223005:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+24:18783:x1875527675837184:12345-192.168.206.18@tcp:101:dd.0 Request processed in 322us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.223011:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 44 00000100:00100000:2.0:1788643186.227845:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643186.227941:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675837440 00000100:00100000:0.0:1788643186.227950:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675837440 00000100:00100000:0.0:1788643186.228013:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 45 00000100:00100000:0.0:1788643186.228022:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+24:18783:x1875527675837440:12345-192.168.206.18@tcp:36:dd.0 00010000:00010000:0.0:1788643186.228231:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.228260:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.228271:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788643186.228316:0:22752:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788643186.228339:0:22752:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005deda214 reply state 000000000d5a8996 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.228351:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643186.228359:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:0.0:1788643186.228362:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788643186.228365:0:22752:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788643186.228488:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+27:18783:x1875527675837440:12345-192.168.206.18@tcp:36:dd.0 Request processed in 466us (650us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788643186.228494:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 45 00000020:00080000:0.0:1788643186.228499:0:22752:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788643186.245431:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643186.245526:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675837568 00000100:00100000:2.0:1788643186.245536:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675837568 00000100:00100000:2.0:1788643186.245588:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:2.0:1788643186.245598:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+27:18783:x1875527675837568:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:2.0:1788643186.245620:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643186.245661:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c43ec lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9db expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.245716:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c43ec lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9db expref: 28 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.245746:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c43ec lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9db expref: 28 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.245766:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:2.0:1788643186.245770:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788643186.245773:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacfe7aa800, rc 0) 00000100:00100000:2.0:1788643186.245883:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+28:18783:x1875527675837568:12345-192.168.206.18@tcp:101:dd.0 Request processed in 286us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.245890:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 46 00000100:00100000:3.0:1788643186.257418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643186.257516:0:23507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675837824 00000100:00100000:1.0:1788643186.257525:0:23507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675837824 00000100:00100000:1.0:1788643186.257588:0:23507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:1.0:1788643186.257598:0:23507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+28:18783:x1875527675837824:12345-192.168.206.18@tcp:103:dd.0 00010000:00010000:1.0:1788643186.257614:0:23507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788643186.257661:0:23507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c43ec lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9db expref: 28 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643186.257680:0:23507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:1.0:1788643186.257685:0:23507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788643186.257742:0:23507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+27:18783:x1875527675837824:12345-192.168.206.18@tcp:103:dd.0 Request processed in 146us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643186.257750:0:23507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 2 00000100:00100000:0.0:1788643186.262213:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643186.262455:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675837952 00000100:00100000:2.0:1788643186.262465:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675837952 00000100:00100000:2.0:1788643186.262515:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:2.0:1788643186.262525:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+27:18783:x1875527675837952:12345-192.168.206.18@tcp:58:dd.0 00010000:00010000:2.0:1788643186.262621:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.262659:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.262671:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788643186.264733:0:22752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788643186.264764:0:22752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788643186.264914:0:22752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788643186.265232:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+27:18783:x1875527675837952:12345-192.168.206.18@tcp:58:dd.0 Request processed in 2704us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643186.265242:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 47 00000100:00100000:3.0:1788643186.267920:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643186.268198:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675838080 00000100:00100000:2.0:1788643186.268207:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675838080 00000100:00100000:2.0:1788643186.268259:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 48 00000100:00100000:2.0:1788643186.268268:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+27:18783:x1875527675838080:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:2.0:1788643186.268287:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643186.268320:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aba00/0x119ccc6e683c43fa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9e2 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.268369:0:22753:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.268409:0:22753:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aba00/0x119ccc6e683c43fa lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9e2 expref: 28 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.268437:0:22753:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.268450:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aba00/0x119ccc6e683c43fa lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9e2 expref: 28 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.268470:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:2.0:1788643186.268474:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788643186.268477:0:22753:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aba00/0x119ccc6e683c43fa lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9e2 expref: 28 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643186.268485:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacfe7aba00, rc 0) 00000100:00100000:2.0:1788643186.268539:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+28:18783:x1875527675838080:12345-192.168.206.18@tcp:101:dd.0 Request processed in 272us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.268545:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 48 00010000:00010000:2.0:1788643186.828473:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643186.893690:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696909056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788643186.893774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643186.893806:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788643186.893824:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc899df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696909184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788643186.893837:0:25551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696909056 00000100:00100000:2.0:1788643186.893846:0:25551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696909056 00000100:00100000:0.0:1788643186.893878:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643186.893916:0:25551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696909184 00000100:00100000:2.0:1788643186.893923:0:25551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696909184 00000100:00080000:0.0:1788643186.893925:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788643186.893930:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788643186.893944:0:25551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788643186.893952:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788643186.893962:0:25551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696909056:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788643186.893966:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696909184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788643186.893997:0:24262:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00002000:00000024:2.0:1788643186.893998:0:25551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788643186.894128:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc899df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696909184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788643186.894903:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788643186.894915:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc8b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696909312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788643186.895099:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696909440:0@lo:400:kworker.0 00000100:00100000:0.0:1788643186.898786:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696909184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4817us (4899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643186.898801:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788643186.898838:0:25551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696909056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4822us (5001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.898848:0:25551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788643186.898853:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696909568:0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.898921:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875527696909824:0@lo:400:kworker.0 00000100:00100000:0.0:1788643186.898921:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643186.898964:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696910080:0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.898976:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643186.898995:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643186.899017:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875527696910592:0@lo:400:kworker.0 00000100:00100000:0.0:1788643186.899049:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696909568 00000100:00100000:2.0:1788643186.899264:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875527696910336:0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.899294:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643186.899321:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788643186.899331:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696909696:0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.899356:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643186.899407:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875527696910208:0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.899520:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643186.899542:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875527696910720:0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.899566:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643186.899604:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696909824 00000100:00100000:2.0:1788643186.899612:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696909824 00000100:00100000:2.0:1788643186.899679:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696910336 00000100:00100000:2.0:1788643186.899683:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696910336 00000100:00100000:2.0:1788643186.899708:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696910208 00000100:00100000:2.0:1788643186.899712:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696910208 00000100:00100000:2.0:1788643186.899723:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696910720 00000100:00100000:2.0:1788643186.899725:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696910720 00000100:00100000:2.0:1788643186.899742:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788643186.899758:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875527696909824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.899841:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875527696909824:12345-0@lo:400:kworker.0 Request processed in 84us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.899849:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788643186.899864:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788643186.899871:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875527696910336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.900257:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875527696910336:12345-0@lo:400:kworker.0 Request processed in 385us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.900266:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788643186.900284:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788643186.900292:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875527696910208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.900324:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875527696910208:12345-0@lo:400:kworker.0 Request processed in 34us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.900330:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788643186.900342:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788643186.900349:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875527696910720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.900378:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875527696910720:12345-0@lo:400:kworker.0 Request processed in 30us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.900410:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788643186.900542:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875527696910208:0@lo:400:kworker.0 00010000:00080000:2.0:1788643186.900557:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cace76ad500 x1875527696910720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788643186.900569:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875527696910720:0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.900580:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875527696909824:0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.900603:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875527696910336:0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.900667:0:25142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696910080 00000100:00100000:2.0:1788643186.900672:0:25142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696910080 00000100:00100000:2.0:1788643186.900713:0:25142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696909696 00000100:00100000:2.0:1788643186.900717:0:25142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696909696 00000100:00100000:2.0:1788643186.900740:0:25142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788643186.900747:0:25142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696910080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.900802:0:25142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696910080:12345-0@lo:400:kworker.0 Request processed in 55us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.900808:0:25142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788643186.900819:0:25142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788643186.900825:0:25142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696909696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.900861:0:25142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696909696:12345-0@lo:400:kworker.0 Request processed in 35us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.900867:0:25142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788643186.900910:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696909696:0@lo:400:kworker.0 00000100:00100000:0.0:1788643186.900950:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696909568 00000100:00080000:2.0:1788643186.900982:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788643186.900993:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788643186.901001:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788643186.901003:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696909568:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788643186.901006:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788643186.901011:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788643186.901067:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875527696909568:12345-0@lo:400:kworker.0 Request processed in 53us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643186.901074:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788643186.901096:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643186.901144:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696909056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788643186.901165:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875527696909568:0@lo:400:kworker.0 00000100:00100000:0.0:1788643186.901175:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696910080:0@lo:400:kworker.0 00000100:00100000:3.0:1788643186.901361:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643186.901501:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696910592 00000100:00100000:2.0:1788643186.901508:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696910592 00000100:00100000:2.0:1788643186.901561:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788643186.901569:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875527696910592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.901611:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875527696910592:12345-0@lo:400:kworker.0 Request processed in 44us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.901627:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788643186.901841:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788643186.901932:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643186.901978:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696909952:0@lo:400:kworker.0 00000100:00100000:1.0:1788643186.902009:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643186.902036:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875527696910464:0@lo:400:kworker.0 00000100:00100000:1.0:1788643186.902071:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643186.902094:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696910464 00000100:00100000:1.0:1788643186.902104:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696910464 00000100:00100000:1.0:1788643186.902141:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788643186.902148:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875527696910464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788643186.902180:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875527696910464:12345-0@lo:400:kworker.0 Request processed in 33us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643186.902186:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788643186.902200:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788643186.902220:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cace76adc00 x1875527696910464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788643202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788643186.902231:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875527696910464:0@lo:400:kworker.0 00000100:00100000:3.0:1788643186.902364:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696909952 00000100:00100000:3.0:1788643186.902369:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696909952 00000100:00100000:3.0:1788643186.902418:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788643186.902426:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696909952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788643186.902462:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696909952:12345-0@lo:400:kworker.0 Request processed in 38us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643186.902479:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788643186.902808:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696909952:0@lo:400:kworker.0 00000100:00100000:0.0:1788643186.902875:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696909312 00000100:00100000:0.0:1788643186.902880:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696909312 00000100:00100000:0.0:1788643186.902918:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788643186.902925:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696909312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788643186.902939:0:24263:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788643186.902993:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875527696909312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643186.903000:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788643186.903031:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875527696910592:0@lo:400:kworker.0 00000100:00100000:1.0:1788643186.903198:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc8b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875527696909312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788643186.903274:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696909440 00000100:00100000:2.0:1788643186.903278:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696909440 00000100:00100000:2.0:1788643186.903315:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788643186.903321:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+24:3642:x1875527696909440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788643186.903743:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da540a41-a984-4ac4-89dc-6d833e36a776+24:3642:x1875527696909440:12345-0@lo:400:kworker.0 Request processed in 420us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643186.903752:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788643186.904155:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da540a41-a984-4ac4-89dc-6d833e36a776:3642:1875527696909440:0@lo:400:kworker.0 00000100:00100000:3.0:1788643186.983318:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643186.983363:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643186.983423:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643186.983448:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643186.983467:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643186.983486:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643186.983506:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643186.983525:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643186.983549:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643186.983575:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675838720 00000100:00100000:3.0:1788643186.983585:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675838720 00000100:00100000:3.0:1788643186.983650:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675839232 00000100:00100000:3.0:1788643186.983654:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675839232 00000100:00100000:3.0:1788643186.983670:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675838592 00000100:00100000:3.0:1788643186.983673:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675838592 00000100:00100000:3.0:1788643186.983684:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675839104 00000100:00100000:3.0:1788643186.983686:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675839104 00000100:00100000:3.0:1788643186.983703:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:3.0:1788643186.983712:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2400:x1875527675838720:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:3.0:1788643186.983775:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2400:x1875527675838720:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 63us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643186.983788:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 15 00000100:00100000:3.0:1788643186.983803:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 16 00000100:00100000:3.0:1788643186.983809:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2400:x1875527675839232:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643186.983946:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:0.0:1788643186.983956:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2400:x1875527675838592:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643186.983986:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2400:x1875527675838592:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 32us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643186.983993:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 17 00000100:00100000:0.0:1788643186.984007:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:0.0:1788643186.984014:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2400:x1875527675839104:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643186.984058:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2400:x1875527675839104:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 44us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643186.984065:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 18 00000100:00100000:0.0:1788643186.984084:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675838208 00000100:00100000:0.0:1788643186.984088:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675838208 00000100:00100000:0.0:1788643186.984115:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 166 00000100:00100000:0.0:1788643186.984123:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cacea757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+13:2400:x1875527675838208:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643186.984147:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cacea757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ce054bfd-e561-4af2-9937-f1d807468f29+13:2400:x1875527675838208:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 25us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643186.984159:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 166 00000100:00100000:0.0:1788643186.984218:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675838464 00000100:00100000:0.0:1788643186.984222:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675838464 00000100:00100000:0.0:1788643186.984239:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675838976 00000100:00100000:0.0:1788643186.984241:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675838976 00000100:00100000:0.0:1788643186.984250:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675838336 00000100:00100000:0.0:1788643186.984252:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675838336 00000100:00100000:0.0:1788643186.984261:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675838848 00000100:00100000:0.0:1788643186.984263:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675838848 00000100:00100000:0.0:1788643186.984275:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:0.0:1788643186.984281:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2400:x1875527675838464:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643186.984307:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2400:x1875527675838464:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 26us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643186.984314:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:0.0:1788643186.984325:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:0.0:1788643186.984331:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2400:x1875527675838976:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643186.984352:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2400:x1875527675838976:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 21us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643186.984357:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:0.0:1788643186.984369:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:0.0:1788643186.984374:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+28:2400:x1875527675838336:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643186.984428:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+28:2400:x1875527675838336:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 52us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643186.984434:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:0.0:1788643186.984445:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 64 00000100:00100000:0.0:1788643186.984457:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+12:2400:x1875527675838848:12345-192.168.206.18@tcp:400:kworker.0 00000100:00100000:0.0:1788643186.984478:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c19b19f4-27dd-4e30-b734-f16bf35fa52d+12:2400:x1875527675838848:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 23us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643186.984484:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 64 00000100:00080000:0.0:1788643186.984517:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788643186.984521:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788643186.984745:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8b31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c19b19f4-27dd-4e30-b734-f16bf35fa52d+5:2400:x1875527675839232:12345-192.168.206.18@tcp:400:kworker.0 Request processed in 935us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643186.984813:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 16 00000040:00080000:1.0:1788643187.147602:0:22787:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788643187.147612:0:22787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788643187.147767:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788643187.147777:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788643187.147899:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76ac380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22787:1875527696910848:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788643187.147988:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacfc0a9540 going to sleep for 11 seconds 00000100:00100000:1.0:1788643187.154812:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76ac380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22787:1875527696910848:192.168.206.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788643187.155151:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.155499:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675839360 00000100:00100000:2.0:1788643187.155506:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675839360 00000100:00100000:2.0:1788643187.155575:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 49 00000100:00100000:2.0:1788643187.155585:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+28:18784:x1875527675839360:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788643187.155614:0:22754:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788643187.155779:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+28:18784:x1875527675839360:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 194us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643187.155787:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 49 00000100:00080000:0.0:1788643187.156258:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788643187.169097:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643187.169227:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675839488 00000100:00100000:1.0:1788643187.169236:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675839488 00000100:00100000:1.0:1788643187.169299:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:1.0:1788643187.169309:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+28:18784:x1875527675839488:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788643187.169442:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4401 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169459:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4401 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169480:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4401 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169533:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c4408 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169541:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c4408 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169547:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c4408 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169567:0:24283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c440f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169575:0:24283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c440f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169580:0:24283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c440f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788643187.169629:0:24283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788643187.169633:0:24283:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788643187.169656:0:24283:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c440f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169667:0:24283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4401 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169679:0:24283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4401 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169687:0:24283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4401 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169692:0:24283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacda5b4e00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:1.0:1788643187.169697:0:24283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4401 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169704:0:24283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4401 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169716:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cacc66f9200) 00010000:00010000:1.0:1788643187.169719:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788643187.169725:0:24283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4401 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169730:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4401 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169742:0:24283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c4408 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169747:0:24283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c4408 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169753:0:24283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c4408 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169758:0:24283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacda5b4000 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:1.0:1788643187.169767:0:24283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c4408 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169773:0:24283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c4408 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169782:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9cabc6b23900) 00010000:00010000:1.0:1788643187.169784:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788643187.169787:0:24283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c4408 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169792:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c4408 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169807:0:24283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c440f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169811:0:24283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c440f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169816:0:24283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c440f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169820:0:24283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacda5b5200 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:1.0:1788643187.169822:0:24283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c440f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169827:0:24283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c440f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169833:0:24283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:1.0:1788643187.169835:0:24283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788643187.169843:0:24283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c440f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.169848:0:24283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c440f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643187.169929:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+28:18784:x1875527675839488:12345-192.168.206.18@tcp:34:lhsmtool_posix.0 Request processed in 621us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643187.169938:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 50 00000100:00100000:3.0:1788643187.176156:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.176297:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675839744 00000100:00100000:2.0:1788643187.176306:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675839744 00000100:00100000:2.0:1788643187.176363:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:2.0:1788643187.176374:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+28:18784:x1875527675839744:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788643187.176421:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643187.176442:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4416 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9e9 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176551:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c441d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176581:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c441d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176592:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c441d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788643187.176602:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788643187.176688:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c441d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176696:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c441d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176703:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c441d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176709:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7aa400 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643187.176713:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c441d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176720:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c441d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176732:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:2.0:1788643187.176735:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788643187.176740:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c441d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176745:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c441d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176791:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4416 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9e9 expref: 30 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176807:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cacc66f9200) 00010000:00010000:2.0:1788643187.176809:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788643187.176813:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4416 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9e9 expref: 30 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.176821:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacfe7ab600, rc 0) 00000100:00100000:2.0:1788643187.176882:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+29:18784:x1875527675839744:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 510us (735us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788643187.176890:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 51 00000100:00100000:3.0:1788643187.183143:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643187.188732:0:24283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675839872 00000100:00100000:1.0:1788643187.188751:0:24283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675839872 00000100:00100000:1.0:1788643187.188826:0:24283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:1.0:1788643187.188836:0:24283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc6bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+29:18784:x1875527675839872:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788643187.188871:0:24283:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788643187.189005:0:24283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc6bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+29:18784:x1875527675839872:12345-192.168.206.18@tcp:53:lhsmtool_posix.0 Request processed in 170us (5870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643187.189012:0:24283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 52 00000100:00100000:0.0:1788643187.193008:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.193106:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675840128 00000100:00100000:2.0:1788643187.193117:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675840128 00000100:00100000:2.0:1788643187.193175:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:2.0:1788643187.193195:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+29:18784:x1875527675840128:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788643187.193214:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643187.193235:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c442b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9f0 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788643187.193813:0:22754:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =60 00000004:00080000:2.0:1788643187.193820:0:22754:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1788643187.193843:0:22754:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788643187.193984:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c4432 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.193999:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c4432 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.194011:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c4432 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.194080:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c442b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9f0 expref: 32 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.194098:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c4432 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9f0 expref: 31 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.194106:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9100) 00010000:00010000:2.0:1788643187.194109:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788643187.194113:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacfe7aa400, rc 0) 00000100:00100000:2.0:1788643187.194332:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+31:18784:x1875527675840128:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 1148us (1332us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788643187.194340:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 53 00000100:00100000:3.0:1788643187.203137:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.203219:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675840384 00000100:00100000:2.0:1788643187.203228:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675840384 00000100:00100000:2.0:1788643187.203290:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:2.0:1788643187.203300:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+31:18784:x1875527675840384:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788643187.203355:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788643187.203421:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa400/0x119ccc6e683c4432 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9f0 expref: 31 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203438:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9100) 00010000:00010000:2.0:1788643187.203450:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788643187.203474:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4440 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203489:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4440 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203521:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4440 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203535:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c4447 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xcebc5826 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203542:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c4447 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcebc5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203547:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c4447 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcebc5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203589:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4440 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203595:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4440 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203601:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4440 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203606:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab600 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643187.203611:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4440 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203618:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4440 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203626:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cabc6b23700) 00010000:00010000:2.0:1788643187.203636:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643187.203648:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4440 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203661:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4440 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203671:0:22753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c4447 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcebc5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203677:0:22753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c4447 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcebc5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203684:0:22753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c4447 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcebc5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203689:0:22753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab000 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643187.203691:0:22753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c4447 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcebc5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203697:0:22753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c4447 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xcebc5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203704:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xcebc5826 (ffff9cacc66f9900) 00010000:00010000:2.0:1788643187.203706:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643187.203709:0:22753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c4447 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xcebc5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.203714:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c4447 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xcebc5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643187.203796:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+30:18784:x1875527675840384:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 497us (666us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788643187.203802:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 54 00000100:00100000:3.0:1788643187.209143:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.209320:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675840512 00000100:00100000:2.0:1788643187.209330:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675840512 00000100:00100000:2.0:1788643187.209411:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:2.0:1788643187.209421:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+30:18784:x1875527675840512:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788643187.209440:0:22754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643187.209460:0:22754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c444e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9f7 expref: -99 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.209723:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4455 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.209738:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4455 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.209751:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4455 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.209856:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c444e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9f7 expref: 32 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.209875:0:22754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7494400/0x119ccc6e683c4455 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9f7 expref: 31 pid: 22754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.209884:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9700) 00010000:00010000:2.0:1788643187.209886:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788643187.209890:0:22754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7494400, rc 0) 00000100:00100000:2.0:1788643187.209946:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+31:18784:x1875527675840512:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 526us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643187.209952:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 55 00000100:00100000:0.0:1788643187.216096:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.216179:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675840768 00000100:00100000:2.0:1788643187.216197:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675840768 00000100:00100000:2.0:1788643187.216252:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:2.0:1788643187.216262:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+31:18784:x1875527675840768:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788643187.216337:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.216354:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.216365:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788643187.216556:0:22753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1788643187.216566:0:22753:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668453185086ns, next at 669453182554ns, rc = 0 00000004:00010000:2.0:1788643187.216627:0:22753:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d3fc929 reply state 00000000edddbf6d transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.216648:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.216656:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9700) 00010000:00010000:2.0:1788643187.216659:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788643187.216662:0:22753:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788643187.216749:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+33:18784:x1875527675840768:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 488us (660us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788643187.216756:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 56 00000100:00100000:3.0:1788643187.221687:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643187.221924:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675840896 00000100:00100000:1.0:1788643187.221933:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675840896 00000100:00100000:1.0:1788643187.222003:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:1.0:1788643187.222014:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+33:18784:x1875527675840896:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788643187.222042:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788643187.222063:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c4463 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25c9fe expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.222119:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c4463 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9fe expref: 34 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.222148:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c4463 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9fe expref: 34 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.222168:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9700) 00010000:00010000:1.0:1788643187.222170:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788643187.222174:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacda5b5200, rc 0) 00000100:00100000:1.0:1788643187.222239:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+34:18784:x1875527675840896:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 227us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643187.222246:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 57 00000100:00100000:3.0:1788643187.243438:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643187.243533:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675841024 00000100:00100000:0.0:1788643187.243543:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675841024 00000100:00100000:0.0:1788643187.243602:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:0.0:1788643187.243611:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2401:x1875527675841024:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788643187.243855:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:2401:x1875527675841024:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 243us (424us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788643187.243862:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:0.0:1788643187.248564:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643187.248836:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675841280 00000100:00100000:1.0:1788643187.248845:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675841280 00000100:00100000:1.0:1788643187.248904:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:1.0:1788643187.248913:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+34:18784:x1875527675841280:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788643187.249129:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+35:18784:x1875527675841280:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 215us (573us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1788643187.249136:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 9 00000100:00100000:3.0:1788643187.259553:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.259666:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675841536 00000100:00100000:2.0:1788643187.259675:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675841536 00000100:00100000:2.0:1788643187.259732:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:2.0:1788643187.259742:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+35:18784:x1875527675841536:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788643187.259867:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+35:18784:x1875527675841536:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 126us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643187.259874:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 58 00000100:00100000:3.0:1788643187.263552:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643187.263721:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675841664 00000100:00100000:1.0:1788643187.263731:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675841664 00000100:00100000:1.0:1788643187.263796:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:1.0:1788643187.263807:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+35:18784:x1875527675841664:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788643187.263826:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788643187.263846:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c446a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25ca05 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.263916:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4471 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.263943:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4471 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.263955:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4471 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788643187.264014:0:22752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788643187.264032:0:22752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4471 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.264059:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c446a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca05 expref: 37 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.264077:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4471 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca05 expref: 36 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.264086:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9700) 00010000:00010000:1.0:1788643187.264089:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788643187.264092:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacda5b4e00, rc 0) 00000100:00100000:1.0:1788643187.264151:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+36:18784:x1875527675841664:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 346us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643187.264158:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 59 00000100:00100000:0.0:1788643187.271991:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.274793:0:25142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675841792 00000100:00100000:2.0:1788643187.274808:0:25142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675841792 00000100:00100000:2.0:1788643187.274875:0:25142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:2.0:1788643187.274885:0:25142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:2402:x1875527675841792:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788643187.274901:0:25142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788643187.274921:0:25142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4478 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25ca0c expref: -99 pid: 25142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788643187.274946:0:25142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c8772, blocks: 0x0 00010000:00010000:2.0:1788643187.274975:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=668s v=(0 0) 00010000:00010000:2.0:1788643187.274980:0:25142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643187.274989:0:25142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4478 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca0c expref: 7 pid: 25142 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.275008:0:25142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4478 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca0c expref: 7 pid: 25142 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.275021:0:25142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cabc7494800, rc 0) 00000100:00100000:2.0:1788643187.275085:0:25142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9405b2ce-0895-49c4-b1fc-39176eea3e3f+7:2402:x1875527675841792:12345-192.168.206.18@tcp:101:lhsmtool_posix.0 Request processed in 202us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643187.275092:0:25142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 22 00000100:00100000:3.0:1788643187.294720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.295010:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675842048 00000100:00100000:2.0:1788643187.295030:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675842048 00000100:00100000:2.0:1788643187.295086:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:2.0:1788643187.295096:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+36:18784:x1875527675842048:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788643187.295193:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+36:18784:x1875527675842048:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 97us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643187.295201:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 60 00000100:00100000:3.0:1788643187.300477:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643187.300727:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675842176 00000100:00100000:1.0:1788643187.300736:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675842176 00000100:00100000:1.0:1788643187.300806:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 61 00000100:00100000:1.0:1788643187.300816:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+36:18784:x1875527675842176:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788643187.304587:0:22732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:1.0:1788643187.304613:0:22732:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788643187.304682:0:22732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:1.0:1788643187.304818:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+19:18784:x1875527675842176:12345-192.168.206.18@tcp:44:lhsmtool_posix.0 Request processed in 4000us (4346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643187.304827:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 61 00010000:00010000:0.0:1788643187.304933:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.304945:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.304952:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.304963:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacda5b5c00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:0.0:1788643187.304979:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.304988:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305002:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9cabc6b23800) 00010000:00010000:0.0:1788643187.305006:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788643187.305010:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305016:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5c00/0x119ccc6e683c4279 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305038:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305044:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305050:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305054:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacda5b5600 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:0.0:1788643187.305057:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305063:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305082:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cabc6b23700) 00010000:00010000:0.0:1788643187.305085:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788643187.305088:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305093:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5600/0x119ccc6e683c4280 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305105:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305111:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305116:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305121:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacf6d3c000 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:0.0:1788643187.305124:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305131:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305137:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9caccc446300) 00010000:00010000:0.0:1788643187.305140:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788643187.305142:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305148:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3c000/0x119ccc6e683c4360 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305172:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305179:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305183:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305188:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e9c00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:0.0:1788643187.305191:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305197:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305204:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:0.0:1788643187.305207:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788643187.305209:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305215:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e9c00/0x119ccc6e683c43e5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305224:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305230:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305235:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305246:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cabc7495c00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:0.0:1788643187.305248:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305253:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305261:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9700) 00010000:00010000:0.0:1788643187.305263:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788643187.305265:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.305270:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cabc7495c00/0x119ccc6e683c445c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.305578:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.305587:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.305592:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.305596:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacff5e8e00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643187.305598:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.305604:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.305612:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cabc6b23700) 00010000:00010000:2.0:1788643187.305614:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788643187.305626:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.305631:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacff5e8e00/0x119ccc6e683c42cd lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643187.306810:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc5dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696910976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788643187.306880:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643187.307081:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696910976 00000100:00100000:3.0:1788643187.307088:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696910976 00000100:00100000:3.0:1788643187.307131:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788643187.307140:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696910976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788643187.307254:0:24259:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788643187.307259:0:24259:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788643187.307261:0:24259:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788643187.307263:0:24259:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788643186 -> 1788643186 00002000:00010000:3.0:1788643187.307266:0:24259:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788643187.307314:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875527696910976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (433us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788643187.307321:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:2.0:1788643187.307546:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cabc5dd4000/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788643187.307553:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc5dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696910976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788643187.309022:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.309120:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675842304 00000100:00100000:2.0:1788643187.309128:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675842304 00000100:00100000:2.0:1788643187.309180:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:2.0:1788643187.309188:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+7:2401:x1875527675842304:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788643187.309269:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5fb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+7:2401:x1875527675842304:12345-192.168.206.18@tcp:16:lhsmtool_posix.0 Request processed in 82us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643187.309276:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 24 00000100:00100000:3.0:1788643187.312479:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.312728:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675842560 00000100:00100000:2.0:1788643187.312737:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675842560 00000100:00100000:2.0:1788643187.312793:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:2.0:1788643187.312802:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+15:18784:x1875527675842560:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788643187.312851:0:22753:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788643187.312877:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4e00/0x119ccc6e683c4471 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca05 expref: 15 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.312893:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9700) 00010000:00010000:2.0:1788643187.312897:0:22753:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788643187.312925:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c447f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.312937:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c447f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.312946:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c447f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788643187.313060:0:22753:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfc4b072 reply state 000000007cea3e83 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c447f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.313072:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa800/0x119ccc6e683c447f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.313078:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9700) 00010000:00010000:2.0:1788643187.313080:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788643187.313083:0:22753:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788643187.313174:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+16:18784:x1875527675842560:12345-192.168.206.18@tcp:36:lhsmtool_posix.0 Request processed in 372us (711us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788643187.313182:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 62 00000100:00100000:3.0:1788643187.324895:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643187.325072:0:24706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675842688 00000100:00100000:1.0:1788643187.325081:0:24706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675842688 00000100:00100000:1.0:1788643187.325134:0:24706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:1.0:1788643187.325144:0:24706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+7:2401:x1875527675842688:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788643187.325281:0:24706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788643187.325285:0:24706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788643185 00002000:00010000:1.0:1788643187.325287:0:24706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788643185 00002000:00010000:1.0:1788643187.325289:0:24706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788643186 -> 1788643185 00002000:00010000:1.0:1788643187.325290:0:24706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788643187.325360:0:24706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+8:2401:x1875527675842688:12345-192.168.206.18@tcp:2:lhsmtool_posix.0 Request processed in 218us (473us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788643187.325367:0:24706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 25 00000100:00100000:0.0:1788643187.336734:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.341297:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675842816 00000100:00100000:2.0:1788643187.341314:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675842816 00000100:00100000:2.0:1788643187.341760:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:2.0:1788643187.341773:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+8:2401:x1875527675842816:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788643187.341814:0:24261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c4486 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.341828:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643187.341832:0:24261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643187.341838:0:24261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c4486 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.341861:0:24261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c4486 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.341901:0:24261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c4486 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.341910:0:24261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c4486 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.341918:0:24261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c4486 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.341925:0:24261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab000 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:2.0:1788643187.341929:0:24261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c4486 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.341937:0:24261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c4486 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.341952:0:24261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c4486 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.341959:0:24261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c4486 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643187.342051:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+8:2401:x1875527675842816:12345-192.168.206.18@tcp:1:lhsmtool_posix.0 Request processed in 280us (5326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643187.342067:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 26 00000100:00100000:3.0:1788643187.344110:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643187.345688:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675843072 00000100:00100000:1.0:1788643187.345700:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675843072 00000100:00100000:1.0:1788643187.345784:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 63 00000100:00100000:1.0:1788643187.345794:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+16:18784:x1875527675843072:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788643187.345870:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.345887:0:22754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa600/0x119ccc6e683c43de lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9d4 expref: 16 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.345912:0:22754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.345945:0:22754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa600/0x119ccc6e683c43de lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9d4 expref: 16 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.345959:0:22754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa600/0x119ccc6e683c43de lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9d4 expref: 16 pid: 22753 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643187.345985:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22754:1875527696911104:192.168.206.18@tcp:104: 00000100:00100000:1.0:1788643187.346374:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacfc0a90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788643187.355123:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643187.355192:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22754:1875527696911104:192.168.206.18@tcp:104: 00010000:00010000:1.0:1788643187.355216:0:22754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643187.355277:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675843200 00000100:00100000:3.0:1788643187.355284:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675843200 00010000:00010000:3.0:1788643187.355319:0:22738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa600/0x119ccc6e683c43de lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9d4 expref: 17 pid: 22753 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643187.355412:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 19 00000100:00100000:3.0:1788643187.355422:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+17:2401:x1875527675843200:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788643187.355436:0:22738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788643187.355442:0:22738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa600/0x119ccc6e683c43de lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9d4 expref: 17 pid: 22753 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.355453:0:22738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa600/0x119ccc6e683c43de lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9d4 expref: 17 pid: 22753 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.355475:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aa600/0x119ccc6e683c43de lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9d4 expref: 17 pid: 22753 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.355491:0:22738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:3.0:1788643187.355497:0:22738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aba00/0x119ccc6e683c43fa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9e2 expref: 16 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.355506:0:22738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.355514:0:22738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.355522:0:22738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.355560:0:22738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788643187.355618:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+16:2401:x1875527675843200:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 192us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643187.355626:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 19 00010000:00010000:2.0:1788643187.355712:0:22754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.355720:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.355911:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.355924:0:22754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c4463 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9fe expref: 16 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.355932:0:22754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.355958:0:22754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c4463 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9fe expref: 16 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.355971:0:22754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c4463 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9fe expref: 16 pid: 22752 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643187.355983:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc899fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22754:1875527696911232:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788643187.356033:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfe000 going to sleep for 11 seconds 00000100:00100000:1.0:1788643187.362456:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.364261:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc899fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22754:1875527696911232:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788643187.364289:0:22754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643187.364441:0:23507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675843328 00000100:00100000:3.0:1788643187.364448:0:23507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675843328 00010000:00010000:3.0:1788643187.364492:0:23507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c4463 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9fe expref: 17 pid: 22752 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643187.364530:0:23507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 20 00000100:00100000:3.0:1788643187.364539:0:23507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+17:2402:x1875527675843328:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788643187.364552:0:23507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788643187.364558:0:23507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c4463 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9fe expref: 17 pid: 22752 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.364570:0:23507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c4463 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9fe expref: 17 pid: 22752 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.364593:0:23507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5200/0x119ccc6e683c4463 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9fe expref: 17 pid: 22752 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.364609:0:23507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9700) 00010000:00010000:3.0:1788643187.364613:0:23507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.364623:0:23507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.364650:0:23507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.364682:0:23507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788643187.364805:0:22754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.364813:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788643187.364927:0:22754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1788643187.365032:0:22754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1788643187.365066:0:22754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1788643187.365139:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22754:1875527696911360:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788643187.365188:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643187.365232:0:23495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696911360 00000100:00100000:1.0:1788643187.365237:0:23495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696911360 00000100:00100000:1.0:1788643187.365267:0:23495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788643187.365274:0:23495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22754:x1875527696911360:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788643187.365337:0:23495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22754:x1875527696911360:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788643187.365345:0:23495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788643187.365367:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefd17780 going to sleep for 11 seconds 00000100:00100000:1.0:1788643187.365408:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22754:1875527696911360:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788643187.365539:0:22754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1788643187.365579:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22754:1875527696911488:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788643187.365608:0:22754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788643187.365632:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696911488 00000100:00100000:1.0:1788643187.365635:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696911488 00000100:00100000:1.0:1788643187.365669:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788643187.365675:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22754:x1875527696911488:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788643187.365759:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22754:x1875527696911488:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (149us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788643187.365765:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788643187.365782:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefd173c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643187.365798:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22754:1875527696911488:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788643187.365822:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.365831:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.365839:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.365865:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab600 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:1.0:1788643187.365869:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.365877:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.365890:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9700) 00010000:00010000:1.0:1788643187.365893:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1788643187.365894:0:23507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9405b2ce-0895-49c4-b1fc-39176eea3e3f+20:2402:x1875527675843328:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 1355us (3445us total) trans 0 rc 0/0 00010000:00010000:1.0:1788643187.365896:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788643187.365902:0:23507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 20 00010000:00010000:1.0:1788643187.365903:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab600/0x119ccc6e683c4494 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.365932:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.365939:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.365945:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.365951:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7aac00 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:1.0:1788643187.365954:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.365960:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.365979:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:1.0:1788643187.365981:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788643187.365986:0:22754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aba00/0x119ccc6e683c43fa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9e2 expref: 19 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.367951:0:22754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aba00/0x119ccc6e683c43fa lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9e2 expref: 19 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.367967:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aba00/0x119ccc6e683c43fa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9e2 expref: 19 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.368044:0:22754:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aba00/0x119ccc6e683c43fa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25c9e2 expref: 19 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643187.368061:0:22754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cace76aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22754:1875527696911616:192.168.206.18@tcp:105: 00000100:00100000:1.0:1788643187.368142:0:22754:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefd179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788643187.374730:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643187.374882:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675843456 00000100:00100000:0.0:1788643187.374894:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675843456 00000100:00100000:0.0:1788643187.374948:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:0.0:1788643187.374958:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc8984850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+20:18783:x1875527675843456:12345-192.168.206.18@tcp:49:dd.0 00000100:00100000:2.0:1788643187.375142:0:22754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cace76aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22754:1875527696911616:192.168.206.18@tcp:105: 00010000:00010000:2.0:1788643187.375167:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375177:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7aac00/0x119ccc6e683c43f3 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375205:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c449b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375217:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c449b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375227:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c449b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375235:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c449b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375240:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c449b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375245:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c449b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375251:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab000 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643187.375254:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c449b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375260:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c449b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375283:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:2.0:1788643187.375285:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788643187.375289:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c449b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375293:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacfe7ab000/0x119ccc6e683c449b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375303:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375308:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375313:0:22754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375317:0:22754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacda5b4000 already unused, calling callback (ffffffffc19314f0) 00010000:00010000:2.0:1788643187.375320:0:22754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375325:0:22754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375331:0:22754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:2.0:1788643187.375333:0:22754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788643187.375335:0:22754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.375339:0:22754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b4000/0x119ccc6e683c448d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788643187.375591:0:22787:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788643187.375597:0:22787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788643187.375612:0:22787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788643187.375618:0:22787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788643187.380036:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc8984850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+20:18783:x1875527675843456:12345-192.168.206.18@tcp:49:dd.0 Request processed in 5068us (5302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643187.380050:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 10 00000100:00100000:2.0:1788643187.381701:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9405b2ce-0895-49c4-b1fc-39176eea3e3f+19:18784:x1875527675843072:12345-192.168.206.18@tcp:57:lhsmtool_posix.0 Request processed in 35899us (37588us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788643187.381715:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 63 00000020:00080000:2.0:1788643187.381722:0:22754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788643187.385739:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643187.386197:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675843712 00000100:00100000:1.0:1788643187.386206:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675843712 00000100:00100000:1.0:1788643187.386261:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 11 00000100:00100000:1.0:1788643187.386271:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc7e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+19:18784:x1875527675843712:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788643187.386551:0:22755:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788643187.386583:0:22755:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:1.0:1788643187.386633:0:22755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5e00/0x119ccc6e683c44a2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.386657:0:22755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5e00/0x119ccc6e683c44a2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.386682:0:22755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5e00/0x119ccc6e683c44a2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.386691:0:22755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5e00/0x119ccc6e683c44a2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.386697:0:22755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5e00/0x119ccc6e683c44a2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.386704:0:22755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5e00/0x119ccc6e683c44a2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.386723:0:22755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788643187.387238:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc7e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+21:18784:x1875527675843712:12345-192.168.206.18@tcp:35:lhsmtool_posix.0 Request processed in 966us (1504us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788643187.387248:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 11 00000020:00080000:1.0:1788643187.387252:0:22755:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788643187.387275:0:22741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788643187.387282:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5e00/0x119ccc6e683c44a2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.387289:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacda5b5e00 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643187.387293:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5e00/0x119ccc6e683c44a2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.387301:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5e00/0x119ccc6e683c44a2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.387312:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cacc66f9700) 00010000:00010000:1.0:1788643187.387314:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788643187.387327:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5e00/0x119ccc6e683c44a2 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.387333:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacda5b5e00/0x119ccc6e683c44a2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.387347:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643187.387349:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643187.387350:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788643187.388183:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:3.0:1788643187.388432:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675843840 00000100:00100000:3.0:1788643187.388441:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675843840 00000100:00100000:3.0:1788643187.388481:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 64 00000100:00100000:3.0:1788643187.388500:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+21:18783:x1875527675843840:12345-192.168.206.18@tcp:101:dd.0 00010000:00010000:3.0:1788643187.388516:0:22753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788643187.388532:0:22753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3cc00/0x119ccc6e683c44a9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7a404ff6db25ca13 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.388558:0:22753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c44b0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.388569:0:22753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c44b0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.388579:0:22753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c44b0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.388705:0:22753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3cc00/0x119ccc6e683c44a9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca13 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.388726:0:22753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cacf6d3ca00/0x119ccc6e683c44b0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca13 expref: 22 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.388734:0:22753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9cacc66f9800) 00010000:00010000:3.0:1788643187.388737:0:22753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788643187.388740:0:22753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cacf6d3ca00, rc 0) 00000100:00100000:3.0:1788643187.389031:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9405b2ce-0895-49c4-b1fc-39176eea3e3f+22:18783:x1875527675843840:12345-192.168.206.18@tcp:101:dd.0 Request processed in 540us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643187.389039:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 64 00000100:00100000:1.0:1788643187.433294:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:1.0:1788643187.433901:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:2.0:1788643187.434007:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675843968 00000100:00100000:2.0:1788643187.434015:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675843968 00000100:00100000:2.0:1788643187.434075:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675844096 00000100:00100000:2.0:1788643187.434078:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675844096 00000100:00100000:2.0:1788643187.434098:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:2.0:1788643187.434107:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+9:2399:x1875527675843968:12345-192.168.206.18@tcp:4:dd.0 00010000:00010000:2.0:1788643187.434138:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.434157:0:24264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4478 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca0c expref: 9 pid: 25142 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.434166:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643187.434170:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788643187.434174:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.434207:0:24264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4478 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca0c expref: 9 pid: 25142 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.434220:0:24264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4478 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca0c expref: 9 pid: 25142 timeout: 768 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788643187.434255:0:24264:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc899fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24264:1875527696911744:192.168.206.18@tcp:104: 00000100:00100000:2.0:1788643187.434605:0:24264:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cacefcfe000 going to sleep for 11 seconds 00000100:00100000:2.0:1788643187.448101:0:24264:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc899fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24264:1875527696911744:192.168.206.18@tcp:104: 00010000:00010000:2.0:1788643187.448129:0:24264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643187.461691:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.18@tcp (source: 12345-192.168.206.18@tcp) 00000100:00100000:0.0:1788643187.461995:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527675844224 00000100:00100000:0.0:1788643187.462004:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527675844224 00010000:00010000:0.0:1788643187.462055:0:22737:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4478 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca0c expref: 10 pid: 25142 timeout: 768 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643187.462099:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 21 00000100:00100000:0.0:1788643187.462109:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+10:2401:x1875527675844224:12345-192.168.206.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788643187.462122:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788643187.462142:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4478 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca0c expref: 10 pid: 25142 timeout: 768 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.462156:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4478 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca0c expref: 10 pid: 25142 timeout: 768 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.462177:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072e07260/0x119ccc6e683c4478 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.18@tcp remote: 0x7a404ff6db25ca0c expref: 10 pid: 25142 timeout: 768 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.462192:0:22737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643187.462196:0:22737:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788643187.462201:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.462210:0:22737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788643187.462243:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788643187.462296:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+9:2401:x1875527675844224:12345-192.168.206.18@tcp:103:ldlm_bl.0 Request processed in 188us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643187.462303:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 21 00010000:00010000:2.0:1788643187.462416:0:24264:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788643187.462425:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788643187.553227:0:24255:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1788643187.553244:0:24255:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:1.0:1788643187.553603:0:24264:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788643187.553608:0:24264:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788643185 -> 1788643186 00002000:00010000:1.0:1788643187.553611:0:24264:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788643185 -> 1788643186 00002000:00010000:1.0:1788643187.553613:0:24264:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1788643187.553734:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.553748:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.553806:0:24264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.553814:0:24264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacfe7ab000 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:1.0:1788643187.553819:0:24264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.553843:0:24264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.553861:0:24264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.553869:0:24264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad90daed/0x119ccc6e683c44b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788643187.553966:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+6:2399:x1875527675843968:12345-192.168.206.18@tcp:4:dd.0 Request processed in 119855us (120675us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788643187.553991:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 0 00000100:00100000:1.0:1788643187.554021:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.18@tcp, seq: 1 00000100:00100000:1.0:1788643187.554032:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cace76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2399:x1875527675844096:12345-192.168.206.18@tcp:4:dd.0 00002000:00010000:1.0:1788643187.554068:0:24264:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 4194304, mtime: 0x6a9c8772, atime: 0x6a9c8771, ctime: 0x6a9c8772, blocks: 0x2000 00010000:00010000:1.0:1788643187.554075:0:24264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b43600a/0x119ccc6e683c44be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.554085:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1788643187.554089:0:24264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788643187.554095:0:24264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b43600a/0x119ccc6e683c44be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788643187.554108:0:24264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b43600a/0x119ccc6e683c44be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788643187.638182:0:24255:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:3.0:1788643187.638471:0:24264:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:3.0:1788643187.638475:0:24264:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:3.0:1788643187.638562:0:24264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b43600a/0x119ccc6e683c44be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.638575:0:24264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b43600a/0x119ccc6e683c44be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.638584:0:24264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b43600a/0x119ccc6e683c44be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.638590:0:24264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cacda5b5200 already unused, calling callback (ffffffffc0d384f0) 00010000:00010000:3.0:1788643187.638595:0:24264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b43600a/0x119ccc6e683c44be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.638684:0:24264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b43600a/0x119ccc6e683c44be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.638706:0:24264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b43600a/0x119ccc6e683c44be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788643187.638713:0:24264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b43600a/0x119ccc6e683c44be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788643187.638937:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cace76ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9405b2ce-0895-49c4-b1fc-39176eea3e3f+5:2399:x1875527675844096:12345-192.168.206.18@tcp:4:dd.0 Request processed in 84904us (205033us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788643187.638951:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.18@tcp, seq: 1 00010000:00010000:2.0:1788643187.854153:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788643188.427752:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc5dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696911872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788643188.427822:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788643188.428533:0:25551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696911872 00000100:00100000:3.0:1788643188.428541:0:25551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696911872 00000100:00100000:3.0:1788643188.428614:0:25551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788643188.428624:0:25551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696911872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788643188.428651:0:25551:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:3.0:1788643188.428701:0:25551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875527696911872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788643188.428708:0:25551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788643188.428763:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc5dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875527696911872:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788643188.428901:0:22748:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788643188.876192:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788643189.382219:0:25839:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1788643189.453130:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc899ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696912000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788643189.453203:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788643189.453270:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696912000 00000100:00100000:2.0:1788643189.453280:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696912000 00000100:00100000:2.0:1788643189.453331:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788643189.453339:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc899ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696912000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788643189.453376:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788643189.453449:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc899ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875527696912000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788643189.453471:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788643189.454244:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788643189.454257:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cabc7e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696912128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788643189.454297:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788643189.454363:0:22757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527696912128 00000100:00100000:0.0:1788643189.454368:0:22757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527696912128 00000100:00100000:0.0:1788643189.454421:0:22757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788643189.454428:0:22757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cabc5dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696912128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788643189.454454:0:22757:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788643189.454515:0:22757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cabc5dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875527696912128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788643189.454522:0:22757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788643189.454662:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc7e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875527696912128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788643189.455001:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cabc899ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875527696912000:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788643189.913038:0:22740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788643190.929346:0:22741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13880 lines, 13880 kept, 0 dropped, 0 bad.