[ 0.000000] Linux version 4.18.0rh8.10-debug (green@maintenance) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-26) (GCC)) #2 SMP Mon Jul 14 01:24:22 EDT 2025 [ 0.000000] Command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffcdfff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bffce000-0x00000000bfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000146dfffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.8 present. [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 [ 0.000000] Hypervisor detected: KVM [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 [ 0.000000] kvm-clock: using sched offset of 562634242 cycles [ 0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns [ 0.000000] tsc: Detected 2399.998 MHz processor [ 0.000000] last_pfn = 0x146e00 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0xbffce max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000f54b0-0x000f54bf] [ 0.000000] RAMDISK: [mem 0xbcc54000-0xbffbffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F52D0 000014 (v00 BOCHS ) [ 0.000000] ACPI: RSDT 0x00000000BFFE247C 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACP 0x00000000BFFE2318 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: DSDT 0x00000000BFFE0040 0022D8 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: FACS 0x00000000BFFE0000 000040 [ 0.000000] ACPI: APIC 0x00000000BFFE238C 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: HPET 0x00000000BFFE241C 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: WAET 0x00000000BFFE2454 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0xbffe2318-0xbffe238b] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe2317] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0xbffe238c-0xbffe241b] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0xbffe241c-0xbffe2453] [ 0.000000] ACPI: Reserving WAET table memory at [mem 0xbffe2454-0xbffe247b] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x0000000146dfffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x1465a3000-0x1465cdfff] [ 0.000000] Reserving 256MB of memory at 2752MB for crashkernel (System RAM: 4205MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009efff] [ 0.000000] node 0: [mem 0x0000000000100000-0x00000000bffcdfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x0000000146dfffff] [ 0.000000] Zeroed struct page in unavailable ranges: 4756 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x0000000146dfffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x608 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000 [ 0.000000] TSC deadline timer available [ 0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs [ 0.000000] kvm-guest: KVM setup pv remote TLB flush [ 0.000000] kvm-guest: setup PV sched yield [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff] [ 0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbffce000-0xbfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff] [ 0.000000] [mem 0xc0000000-0xfeffbfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on KVM [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u524288 [ 0.000000] kvm-guest: PV spinlocks enabled [ 0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1059606 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: rd.shell root=nbd:192.168.200.253:rocky8.10:ext4:ro:-p,-b4096 ro crashkernel=256M panic=1 nomodeset ipmtu=9000 ip=dhcp rd.neednet=1 init_on_free=off mitigations=off console=ttyS1,115200 audit=0 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] audit: disabled (until reboot) [ 0.000000] software IO TLB: area num 4. [ 0.000000] Memory: 2829652K/4306352K available (18435K kernel code, 11221K rwdata, 7248K rodata, 2908K init, 18040K bss, 524580K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 [ 0.000000] kmemleak: Kernel memory leak detector disabled [ 0.000000] ftrace: allocating 41240 entries in 162 pages [ 0.000000] ftrace: allocated 162 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU event tracing is enabled. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4. [ 0.000000] rcu: RCU callback double-/use-after-free debug enabled. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 [ 0.000000] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16 [ 0.000000] random: get_random_bytes called from start_kernel+0x622/0x9a8 with crng_init=0 [ 0.001000] Console: colour *CGA 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns [ 0.001010] APIC: Switch to symmetric I/O mode setup [ 0.002260] x2apic enabled [ 0.003006] Switched APIC routing to physical x2apic. [ 0.004011] kvm-guest: setup PV IPIs [ 0.007301] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.008000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 0.008020] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998) [ 0.009013] pid_max: default: 32768 minimum: 301 [ 0.010131] LSM: Security Framework initializing [ 0.011045] Yama: becoming mindful. [ 0.012030] SELinux: Initializing. [ 0.013046] *** VALIDATE selinux *** [ 0.021142] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, vmalloc) [ 0.026174] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc) [ 0.028096] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.029099] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, vmalloc) [ 0.030119] *** VALIDATE tmpfs *** [ 0.031439] *** VALIDATE proc *** [ 0.032215] *** VALIDATE cgroup *** [ 0.033005] *** VALIDATE cgroup2 *** [ 0.034240] x86/cpu: User Mode Instruction Prevention (UMIP) activated [ 0.036047] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0 [ 0.037005] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0 [ 0.038027] Spectre V2 : User space: Vulnerable [ 0.039008] Speculative Store Bypass: Vulnerable [ 0.042350] debug: unmapping init [mem 0xffffffffa9e59000-0xffffffffa9e60fff] [ 0.044000] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2695 v2 @ 2.40GHz (family: 0x6, model: 0x3e, stepping: 0x4) [ 0.044585] Performance Events: IvyBridge events, full-width counters, Intel PMU driver. [ 0.045022] ... version: 2 [ 0.046012] ... bit width: 48 [ 0.047015] ... generic registers: 4 [ 0.048011] ... value mask: 0000ffffffffffff [ 0.049014] ... max period: 00007fffffffffff [ 0.050013] ... fixed-purpose events: 3 [ 0.051008] ... event mask: 000000070000000f [ 0.052281] rcu: Hierarchical SRCU implementation. [ 0.054451] smp: Bringing up secondary CPUs ... [ 0.055606] x86: Booting SMP configuration: [ 0.056022] .... node #0, CPUs: #1 #2 #3 [ 0.066192] smp: Brought up 1 node, 4 CPUs [ 0.068016] smpboot: Max logical packages: 1 [ 0.069018] smpboot: Total of 4 processors activated (19199.98 BogoMIPS) [ 0.095330] node 0 deferred pages initialised in 24ms [ 0.099008] devtmpfs: initialized [ 0.100260] x86/mm: Memory block size: 128MB [ 0.103057] gcov: version magic: 0x41383552 [ 0.105239] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.106079] futex hash table entries: 1024 (order: 4, 65536 bytes, vmalloc) [ 0.107261] pinctrl core: initialized pinctrl subsystem [ 0.108213] [ 0.108737] ************************************************************* [ 0.109015] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.110014] ** ** [ 0.111015] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL ** [ 0.112015] ** ** [ 0.113019] ** This means that this kernel is built to expose internal ** [ 0.114017] ** IOMMU data structures, which may compromise security on ** [ 0.115015] ** your system. ** [ 0.116017] ** ** [ 0.117015] ** If you see this message and you are not debugging the ** [ 0.118011] ** kernel, report this immediately to your vendor! ** [ 0.119013] ** ** [ 0.120017] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE ** [ 0.121013] ************************************************************* [ 0.122808] NET: Registered protocol family 16 [ 0.124050] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations [ 0.125065] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.126202] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.127786] cpuidle: using governor menu [ 0.130039] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.132866] PCI: Using configuration type 1 for base access [ 0.135123] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.142418] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.144181] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.147091] cryptd: max_cpu_qlen set to 1000 [ 0.148391] ACPI: Added _OSI(Module Device) [ 0.150012] ACPI: Added _OSI(Processor Device) [ 0.150993] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.152011] ACPI: Added _OSI(Processor Aggregator Device) [ 0.155042] ACPI: 1 ACPI AML tables successfully acquired and loaded [ 0.159416] ACPI: Interpreter enabled [ 0.160181] ACPI: PM: (supports S0 S3 S4 S5) [ 0.161008] ACPI: Using IOAPIC for interrupt routing [ 0.162082] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.165249] ACPI: Enabled 2 GPEs in block 00 to 0F [ 0.175239] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) [ 0.176032] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3] [ 0.178014] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI] [ 0.180065] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge. [ 0.184042] acpiphp: Slot [2] registered [ 0.184967] acpiphp: Slot [5] registered [ 0.186058] acpiphp: Slot [6] registered [ 0.187022] acpiphp: Slot [7] registered [ 0.187980] acpiphp: Slot [8] registered [ 0.189049] acpiphp: Slot [9] registered [ 0.190148] acpiphp: Slot [10] registered [ 0.191114] acpiphp: Slot [3] registered [ 0.193084] acpiphp: Slot [4] registered [ 0.194096] acpiphp: Slot [11] registered [ 0.196081] acpiphp: Slot [12] registered [ 0.197055] acpiphp: Slot [13] registered [ 0.198000] acpiphp: Slot [14] registered [ 0.198000] acpiphp: Slot [15] registered [ 0.200090] acpiphp: Slot [16] registered [ 0.201090] acpiphp: Slot [17] registered [ 0.202086] acpiphp: Slot [18] registered [ 0.204101] acpiphp: Slot [19] registered [ 0.205103] acpiphp: Slot [20] registered [ 0.206111] acpiphp: Slot [21] registered [ 0.207085] acpiphp: Slot [22] registered [ 0.209081] acpiphp: Slot [23] registered [ 0.211119] acpiphp: Slot [24] registered [ 0.213081] acpiphp: Slot [25] registered [ 0.214102] acpiphp: Slot [26] registered [ 0.215108] acpiphp: Slot [27] registered [ 0.217112] acpiphp: Slot [28] registered [ 0.218131] acpiphp: Slot [29] registered [ 0.220107] acpiphp: Slot [30] registered [ 0.221128] acpiphp: Slot [31] registered [ 0.223108] PCI host bridge to bus 0000:00 [ 0.225025] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.228024] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] [ 0.230021] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.233028] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] [ 0.235020] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] [ 0.237021] pci_bus 0000:00: root bus resource [bus 00-ff] [ 0.238168] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 [ 0.241159] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 [ 0.243117] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 [ 0.251017] pci 0000:00:01.1: reg 0x20: [io 0xc320-0xc32f] [ 0.256053] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] [ 0.257000] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] [ 0.257000] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] [ 0.260015] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] [ 0.261600] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 [ 0.263814] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI [ 0.267039] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB [ 0.268749] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 [ 0.273013] pci 0000:00:02.0: reg 0x10: [io 0xc300-0xc31f] [ 0.284016] pci 0000:00:02.0: reg 0x20: [mem 0xe0000000000-0xe0000003fff 64bit pref] [ 0.288014] pci 0000:00:02.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref] [ 0.318134] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 [ 0.320000] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] [ 0.320000] pci 0000:00:05.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff] [ 0.332020] pci 0000:00:05.0: reg 0x20: [mem 0xe0000004000-0xe0000007fff 64bit pref] [ 0.339235] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 [ 0.344016] pci 0000:00:06.0: reg 0x10: [io 0xc080-0xc0ff] [ 0.348011] pci 0000:00:06.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff] [ 0.360016] pci 0000:00:06.0: reg 0x20: [mem 0xe0000008000-0xe000000bfff 64bit pref] [ 0.369023] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 [ 0.375016] pci 0000:00:07.0: reg 0x10: [io 0xc100-0xc17f] [ 0.381016] pci 0000:00:07.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff] [ 0.397027] pci 0000:00:07.0: reg 0x20: [mem 0xe000000c000-0xe000000ffff 64bit pref] [ 0.405000] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 [ 0.412015] pci 0000:00:08.0: reg 0x10: [io 0xc180-0xc1ff] [ 0.417016] pci 0000:00:08.0: reg 0x14: [mem 0xfebc3000-0xfebc3fff] [ 0.427013] pci 0000:00:08.0: reg 0x20: [mem 0xe0000010000-0xe0000013fff 64bit pref] [ 0.434527] pci 0000:00:09.0: [1af4:1001] type 00 class 0x010000 [ 0.438014] pci 0000:00:09.0: reg 0x10: [io 0xc200-0xc27f] [ 0.445020] pci 0000:00:09.0: reg 0x14: [mem 0xfebc4000-0xfebc4fff] [ 0.454015] pci 0000:00:09.0: reg 0x20: [mem 0xe0000014000-0xe0000017fff 64bit pref] [ 0.462102] pci 0000:00:0a.0: [1af4:1001] type 00 class 0x010000 [ 0.471026] pci 0000:00:0a.0: reg 0x10: [io 0xc280-0xc2ff] [ 0.481018] pci 0000:00:0a.0: reg 0x14: [mem 0xfebc5000-0xfebc5fff] [ 0.500018] pci 0000:00:0a.0: reg 0x20: [mem 0xe0000018000-0xe000001bfff 64bit pref] [ 0.509031] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 [ 0.511314] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.513271] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 [ 0.514308] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.517138] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 [ 0.520223] iommu: Default domain type: Passthrough [ 0.521000] SCSI subsystem initialized [ 0.521000] ACPI: bus type USB registered [ 0.523087] usbcore: registered new interface driver usbfs [ 0.524073] usbcore: registered new interface driver hub [ 0.526082] usbcore: registered new device driver usb [ 0.527170] pps_core: LinuxPPS API ver. 1 registered [ 0.529008] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.531072] PTP clock support registered [ 0.532219] EDAC MC: Ver: 3.0.0 [ 0.534145] PCI: Using ACPI for IRQ routing [ 0.535887] NetLabel: Initializing [ 0.537018] NetLabel: domain hash size = 128 [ 0.538006] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.539070] NetLabel: unlabeled traffic allowed by default [ 0.541333] vgaarb: loaded [ 0.542554] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 0.544010] hpet0: 3 comparators, 64-bit 100.000000 MHz counter [ 0.549554] clocksource: Switched to clocksource kvm-clock [ 0.672440] VFS: Disk quotas dquot_6.6.0 [ 0.673612] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.675275] *** VALIDATE ramfs *** [ 0.676191] *** VALIDATE hugetlbfs *** [ 0.677916] pnp: PnP ACPI init [ 0.679915] pnp: PnP ACPI: found 6 devices [ 0.694644] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.697147] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 0.698872] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 0.700627] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 0.702309] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] [ 0.704038] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] [ 0.706550] NET: Registered protocol family 2 [ 0.708558] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc) [ 0.713107] tcp_listen_portaddr_hash hash table entries: 4096 (order: 5, 163840 bytes, vmalloc) [ 0.715930] TCP established hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.720338] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc) [ 0.723474] TCP: Hash tables configured (established 65536 bind 65536) [ 0.725616] MPTCP token hash table entries: 8192 (order: 6, 393216 bytes, vmalloc) [ 0.727819] UDP hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.729908] UDP-Lite hash table entries: 4096 (order: 6, 393216 bytes, vmalloc) [ 0.732358] NET: Registered protocol family 1 [ 0.734737] RPC: Registered named UNIX socket transport module. [ 0.736391] RPC: Registered udp transport module. [ 0.737765] RPC: Registered tcp transport module. [ 0.738988] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 0.740598] NET: Registered protocol family 44 [ 0.741947] pci 0000:00:00.0: Limiting direct PCI/PCI transfers [ 0.743308] pci 0000:00:01.0: PIIX3: Enabling Passive Release [ 0.745280] pci 0000:00:01.0: Activating ISA DMA hang workarounds [ 0.747238] PCI: CLS 0 bytes, default 64 [ 0.748744] Unpacking initramfs... [ 2.424286] debug: unmapping init [mem 0xffff9e17fcc54000-0xffff9e17fffbffff] [ 2.428297] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 2.430799] software IO TLB: mapped [mem 0x00000000a8000000-0x00000000ac000000] (64MB) [ 2.433816] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229835b7123, max_idle_ns: 440795242976 ns [ 2.960285] Initialise system trusted keyrings [ 2.962023] Key type blacklist registered [ 2.963867] workingset: timestamp_bits=36 max_order=20 bucket_order=0 [ 2.972967] zbud: loaded [ 2.975862] *** VALIDATE nfs *** [ 2.977143] *** VALIDATE nfs4 *** [ 2.978648] pstore: using deflate compression [ 2.982244] Platform Keyring initialized [ 3.094466] NET: Registered protocol family 38 [ 3.095947] Key type asymmetric registered [ 3.097242] Asymmetric key parser 'x509' registered [ 3.100428] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.103757] io scheduler mq-deadline registered [ 3.105376] io scheduler kyber registered [ 3.106862] io scheduler bfq registered [ 3.108844] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.111823] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.115895] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 3.121878] ACPI: Power Button [PWRF] [ 3.127369] ACPI: \_SB_.LNKB: Enabled at IRQ 10 [ 3.134792] ACPI: \_SB_.LNKA: Enabled at IRQ 11 [ 3.146870] ACPI: \_SB_.LNKC: Enabled at IRQ 11 [ 3.153555] ACPI: \_SB_.LNKD: Enabled at IRQ 10 [ 3.167785] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.195139] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.231976] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.236460] Non-volatile memory driver v1.3 [ 3.238160] Linux agpgart interface v0.103 [ 3.269851] virtio_blk virtio1: [vda] 146216 512-byte logical blocks (74.9 MB/71.4 MiB) [ 3.272989] vda: detected capacity change from 0 to 74862592 [ 3.292104] virtio_blk virtio2: [vdb] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) [ 3.296557] vdb: detected capacity change from 0 to 1073741824 [ 3.316592] virtio_blk virtio3: [vdc] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.320980] vdc: detected capacity change from 0 to 2621440000 [ 3.339518] virtio_blk virtio4: [vdd] 5120000 512-byte logical blocks (2.62 GB/2.44 GiB) [ 3.342391] vdd: detected capacity change from 0 to 2621440000 [ 3.359338] virtio_blk virtio5: [vde] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.362773] vde: detected capacity change from 0 to 4294967296 [ 3.387286] virtio_blk virtio6: [vdf] 8388608 512-byte logical blocks (4.29 GB/4.00 GiB) [ 3.392459] vdf: detected capacity change from 0 to 4294967296 [ 3.416497] libphy: Fixed MDIO Bus: probed [ 3.426337] usbcore: registered new interface driver usbserial_generic [ 3.428804] usbserial: USB Serial support registered for generic [ 3.431394] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 [ 3.435159] serio: i8042 KBD port at 0x60,0x64 irq 1 [ 3.436605] serio: i8042 AUX port at 0x60,0x64 irq 12 [ 3.439173] mousedev: PS/2 mouse device common for all mice [ 3.443355] rtc_cmos 00:05: RTC can wake from S4 [ 3.446234] rtc_cmos 00:05: registered as rtc0 [ 3.448029] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs [ 3.450284] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 [ 3.451493] intel_pstate: CPU model not supported [ 3.453882] hid: raw HID events driver (C) Jiri Kosina [ 3.461096] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 [ 3.464214] usbcore: registered new interface driver usbhid [ 3.467835] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 [ 3.473216] usbhid: USB HID core driver [ 3.474721] drop_monitor: Initializing network drop monitor service [ 3.477241] Initializing XFRM netlink socket [ 3.479550] NET: Registered protocol family 10 [ 3.482652] Segment Routing with IPv6 [ 3.484204] NET: Registered protocol family 17 [ 3.486270] mpls_gso: MPLS GSO support [ 3.492678] RAS: Correctable Errors collector initialized. [ 3.494729] AVX version of gcm_enc/dec engaged. [ 3.496408] AES CTR mode by8 optimization enabled [ 3.576762] sched_clock: Marking stable (3576680169, 0)->(4551952827, -975272658) [ 3.581964] registered taskstats version 1 [ 3.584717] Loading compiled-in X.509 certificates [ 3.587041] zswap: loaded using pool lzo/zbud [ 3.619916] Key type big_key registered [ 3.633412] Key type encrypted registered [ 3.635264] ima: No TPM chip found, activating TPM-bypass! [ 3.637809] ima: Allocated hash algorithm: sha1 [ 3.639839] ima: No architecture policies found [ 3.641524] evm: Initialising EVM extended attributes: [ 3.643484] evm: security.selinux [ 3.644502] evm: security.ima [ 3.645513] evm: security.capability [ 3.646927] evm: HMAC attrs: 0x1 [ 3.649705] rtc_cmos 00:05: setting system clock to 2026-07-28 06:18:31 UTC (1785219511) [ 3.657863] debug: unmapping init [mem 0xffffffffaae03000-0xffffffffaaffffff] [ 3.661240] debug: unmapping init [mem 0xffffffffa9b82000-0xffffffffa9e58fff] [ 3.670130] Write protecting the kernel read-only data: 28672k [ 3.673874] debug: unmapping init [mem 0xffffffffa8203000-0xffffffffa83fffff] [ 3.676704] debug: unmapping init [mem 0xffffffffa8b14000-0xffffffffa8bfffff] [ 3.712775] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.720885] systemd[1]: Detected virtualization kvm. [ 3.723354] systemd[1]: Detected architecture x86-64. [ 3.725306] systemd[1]: Running in initial RAM disk. Welcome to Rocky Linux 8.10 (Green Obsidian) dracut-049-233.git20240115.el8 (Initramfs)! [ 3.762904] systemd[1]: No hostname configured. [ 3.764803] systemd[1]: Set hostname to . [ 3.767325] random: systemd: uninitialized urandom read (16 bytes read) [ 3.770262] systemd[1]: Initializing machine ID from random generator. [ 3.887114] random: ln: uninitialized urandom read (6 bytes read) [ 4.022349] random: systemd: uninitialized urandom read (16 bytes read) [ 4.024412] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.027656] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 4.030961] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Reached target Local File Systems. [ OK ] Listening on Journal Socket. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Reached target Timers. Starting Create Volatile Files and Directories... Starting Apply Kernel Variables... [ OK ] Reached target Initrd Root Device. [ OK ] Listening on udev Control Socket. [ OK ] Started Memstrack Anylazing Service. Starting Setup Virtual Console... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Journal Service... [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. [ OK ] Started Apply Kernel Variables. [ OK ] Started Setup Virtual Console. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Journal Service. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ 4.985565] device-mapper: uevent: version 1.0.3 [ 4.987567] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting dracut pre-trigger hook... [ OK ] Started dracut pre-trigger hook. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. [ OK ] Reached target Basic System. [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ 6.220066] virtio_net virtio0 ens2: renamed from eth0 [ 6.313957] random: fast init done [ 6.595821] scsi host0: ata_piix [ 6.734345] scsi host1: ata_piix [ 6.735546] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc320 irq 14 [ 6.748299] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc328 irq 15 [ 12.180115] random: crng init done [ 12.185707] random: 7 urandom warning(s) missed due to ratelimiting [ 14.658662] dracut-initqueue[577]: RTNETLINK answers: File exists Starting nbd nbd0... [ OK ] Started nbd nbd0. [ OK ] Started dracut initqueue hook. Mounting /sysroot... [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. [ 16.984769] EXT4-fs (nbd0): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Stopping Hardware RNG Entropy Gatherer Daemon... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Timers. [ OK ] Stopped Hardware RNG Entropy Gatherer Daemon. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped dracut pre-trigger hook. Stopping udev Kernel Device Manager... [ OK ] Stopped target Local Encrypted Volumes. [ OK ] Stopped Dispatch Password Requests to Console Directory Watch. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swap. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Started Cleanup udevd DB. [ OK ] Reached target Switch Root. Starting Switch Root... [ 20.269307] printk: systemd: 26 output lines suppressed due to ratelimiting [ 21.216356] SELinux: Disabled at runtime. [ 21.380234] systemd[1]: systemd 239 (239-82.el8_10.5) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 21.408370] systemd[1]: Detected virtualization kvm. [ 21.410281] systemd[1]: Detected architecture x86-64. Welcome to Rocky Linux 8.10 (Green Obsidian)! [ 23.593227] systemd[1]: initrd-switch-root.service: Succeeded. [ 23.605976] systemd[1]: Stopped Switch Root. [ OK ] Stopped Switch Root. [ 23.630541] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. [ 23.641900] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 23.655968] systemd[1]: Stopped Journal Service. [ OK ] Stopped Journal Service. [ 23.693462] systemd[1]: Starting Journal Service... Starting Journal Service... [ 23.715838] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. Mounting Kernel Debug File System... [ OK ] Reached target rpc_pipefs.target. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Listening on RPCbind Server Activation Socket. Mounting POSIX Message Queue File System... [ OK ] Started Dispatch Password Requests to Console Directory Watch. [ OK ] Started Forward Password Requests to Wall Directory Watch. Starting Remount Root and Kernel File Systems... [ OK ] Reached target Local Encrypted Volumes. Starting Create list of required st…ce nodes for the current kernel... Activating swap /dev/disk/by-label/SWAP... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK [0[ 24.151186] Adding 1048572k swap on /dev/vdb. Priority:-2 extents:1 across:1048572k FS m] Listening on Process Core Dump Socket. [ OK ] Reached target Slices. [ OK ] Created slice system-getty.slice. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on initctl Compatibility Named Pipe. Starting Apply Kernel Variables... Mounting Huge Pages File System... [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on udev Control Socket. Starting udev Coldplug all Devices... [ OK ] Reached target Paths. [FAILED] Failed to set up automount Arbitrar…rmats File System Automount Point. See 'systemctl status proc-sys-fs-binfmt_misc.automount' for details. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Journal Service. [FAILED] Failed to start Remount Root and Kernel File Systems. See 'systemctl status systemd-remount-fs.service' for details. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Activated swap /dev/disk/by-label/SWAP. [ OK ] Started Apply Kernel Variables. [ OK ] Mounted Huge Pages File System. [ OK ] Reached target Swap. Starting Configure read-only root support... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). Mounting /mnt... Mounting /home/green/git/lustre-release... [ OK ] Started udev Coldplug all Devices. [ OK ] Mounted /mnt. [ 25.685849] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ OK ] Mounted /home/green/git/lustre-release. [ OK ] Started udev Kernel Device Manager. [ 26.990981] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 [ 27.054781] input: PC Speaker as /devices/platform/pcspkr/input/input5 [ 28.026162] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer [ 28.114901] EDAC sbridge: Ver: 1.1.2 [* ] A start job is running for Configur…-only root support (8s / no limit) [** ] A start job is running for Configur…-only root support (8s / no limit) [*** ] A start job is running for Configur…-only root support (9s / no limit)[ 33.188612] Key type dns_resolver registered [ *** ] A start job is running for Configur…-only root support (9s / no limit) [ *** ] A start job is running for Configur…only root support (10s / no limit) [ ***] A start job is running for Configur…only root support (10s / no limit) [ **] A start job is running for Configur…only root support (11s / no limit)[ 34.886732] NFS: Registering the id_resolver key type [ 34.896328] Key type id_resolver registered [ 34.901797] Key type id_legacy registered [ *] A start job is running for Configur…only root support (11s / no limit) [ **] A start job is running for Configur…only root support (12s / no limit) [ OK ] Started Configure read-only root support. [ OK ] Reached target Local File Systems. Starting Rebuild Dynamic Linker Cache... Starting Mark the need to relabel after reboot... Starting Load/Save Random Seed... Starting Create Volatile Files and Directories... [ OK ] Started Mark the need to relabel after reboot. [ OK ] Started Load/Save Random Seed. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Started RPC Bind. [ OK ] Started Rebuild Dynamic Linker Cache. Starting Update is Completed... [ OK ] Started Update is Completed. [ OK ] Reached target System Initialization. [ OK ] Started dnf makecache --timer. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Login Service... [ OK ] Started Hardware RNG Entropy Gatherer Daemon. [ OK ] Reached target sshd-keygen.target. [ OK ] Started irqbalance daemon. Starting Restore /run/initramfs on shutdown... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Started Login Service. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started OpenSSH server daemon. [ OK ] Started Permit User Sessions. [ OK ] Started Serial Getty on ttyS1. [ OK ] Started Serial Getty on ttyS0. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started Command Scheduler. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. Rocky Linux 8.10 (Green Obsidian) Kernel 4.18.0rh8.10-debug on an x86_64 oleg231-server login: [ 58.446025] hrtimer: interrupt took 11016564 ns [ 102.404380] libcfs: loading out-of-tree module taints kernel. [ 102.493573] Key type ._llcrypt registered [ 102.496162] Key type .llcrypt registered [ 102.617183] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 121.630530] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 123.344192] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 123.351780] alg: No test for adler32 (adler32-zlib) [ 124.983593] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 125.745376] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 127.528839] Key type lgssc registered [ 129.033341] Lustre: Echo OBD driver; http://www.lustre.org/ [ 146.399988] ZFS: Loaded module v2.3.2-1, ZFS pool version 5000, ZFS filesystem version 5 [ 185.009705] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 197.131986] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 197.169343] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 198.402903] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 198.435930] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 198.534279] Lustre: lustre-MDT0000: new disk, initializing [ 198.618697] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 198.642398] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 203.452769] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 216.587304] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 216.739154] Lustre: 6503:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 216.796221] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 216.799240] Lustre: Skipped 1 previous similar message [ 216.808904] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 216.932908] Lustre: lustre-MDT0001: new disk, initializing [ 217.026540] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 217.056223] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 217.084024] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 221.724873] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 226.960199] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 236.302443] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 236.634890] Lustre: lustre-OST0000: new disk, initializing [ 236.638419] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 236.646844] Lustre: 8440:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 236.745774] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 237.142891] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 237.156584] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 237.273870] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 242.832539] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 256.906864] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 256.997378] Lustre: lustre-OST0001: new disk, initializing [ 257.003810] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 257.007758] Lustre: 9512:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 257.065748] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 263.610674] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all [ 265.237812] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 265.255817] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 265.355357] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 276.169484] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 283.317616] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 290.868372] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing check_logdir /tmp/testlogs/ [ 295.971807] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing yml_node [ 300.515728] Lustre: DEBUG MARKER: Client: 2.17.54.204 [ 303.571250] Lustre: DEBUG MARKER: MDS: 2.17.54.204 [ 306.558987] Lustre: DEBUG MARKER: OSS: 2.17.54.204 [ 308.225729] Lustre: DEBUG MARKER: -----============= acceptance-small: conf-sanity ============----- Tue Jul 28 02:23:34 EDT 2026 [ 325.199326] Lustre: DEBUG MARKER: excepting tests: 102 106 115 32newtarball [ 326.934910] Lustre: DEBUG MARKER: skipping tests SLOW=no: 45 69 106 111 114 [ 345.055548] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 345.061052] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 345.078506] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 347.104376] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 347.110035] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 347.117258] Lustre: Skipped 2 previous similar messages [ 347.126101] Lustre: Skipped 3 previous similar messages [ 349.700128] Lustre: server umount lustre-MDT0000 complete [ 353.103155] LustreError: 10387:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785219860 with bad export cookie 8264518451053027752 [ 353.111727] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 357.344060] LustreError: 6511:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 357.345570] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 357.346139] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 357.365192] LustreError: 6511:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 6 previous similar messages [ 357.397326] Lustre: Skipped 1 previous similar message [ 358.371740] LustreError: 6511:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 358.391884] LustreError: 6511:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 359.478992] Lustre: server umount lustre-MDT0001 complete [ 363.604346] Lustre: server umount lustre-OST0000 complete [ 367.275893] Lustre: server umount lustre-OST0001 complete [ 373.880586] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 383.237714] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 420.660712] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 420.985433] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 421.012178] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 421.093252] Lustre: lustre-MDT0000: new disk, initializing [ 421.209849] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 421.221479] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 426.971508] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 437.898964] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 438.028606] Lustre: 15066:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 438.098559] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 438.101717] Lustre: Skipped 1 previous similar message [ 438.213180] Lustre: lustre-MDT0001: new disk, initializing [ 438.374040] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 438.458475] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 438.472577] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 443.608460] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 453.621370] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 459.569419] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 467.166179] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 467.602886] Lustre: lustre-OST0000: new disk, initializing [ 467.609218] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 467.613412] Lustre: 17034:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 467.743471] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 469.485574] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 469.504798] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 469.675386] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 476.302720] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 488.047103] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 493.065854] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 493.291635] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 498.296321] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 498.520879] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 500.705118] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 500.716596] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 500.730992] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 500.738913] Lustre: Skipped 3 previous similar messages [ 505.313090] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 505.321568] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 506.452255] Lustre: server umount lustre-OST0000 complete [ 510.949179] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 510.958279] Lustre: Skipped 3 previous similar messages [ 517.204662] Lustre: server umount lustre-MDT0000 complete [ 521.186336] LustreError: 15080:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 521.202725] LustreError: 15080:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 521.324279] LustreError: 15059:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785220029 with bad export cookie 8264518451053029285 [ 521.327031] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 521.339456] LustreError: 15059:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 521.727535] Lustre: server umount lustre-MDT0001 complete [ 527.732593] Lustre: DEBUG MARKER: == conf-sanity test 76a: set permanent params with lctl across mounts ========================================================== 02:27:14 (1785220034) [ 534.089721] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 534.559040] LustreError: 19302:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 534.640044] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 539.189908] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 540.144358] LustreError: 19303:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 548.295513] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 552.975692] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 560.924841] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 566.898210] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 574.049115] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 580.529816] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 588.725887] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 595.895382] Lustre: Modifying parameter general.osc.*.max_dirty_mb=452 in log params [ 604.130269] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 604.132976] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 604.151561] Lustre: Skipped 4 previous similar messages [ 604.160813] Lustre: Skipped 4 previous similar messages [ 609.384593] Lustre: server umount lustre-MDT0000 complete [ 613.306584] LustreError: 19283:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785220121 with bad export cookie 8264518451053030167 [ 613.324229] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 613.663181] Lustre: server umount lustre-MDT0001 complete [ 627.932133] Lustre: server umount lustre-OST0000 complete [ 651.111607] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 661.877375] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 662.314704] LustreError: 23686:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 662.342295] LustreError: 23686:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 662.428697] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 662.431173] Lustre: Skipped 2 previous similar messages [ 668.475139] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 678.270131] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 684.338460] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 687.237485] Lustre: Setting parameter general.debug_raw_pointers=Y in log params [ 695.574423] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 704.164890] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 714.966242] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 715.088984] Lustre: lustre-OST0001: new disk, initializing [ 715.092567] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 715.097495] Lustre: 26000:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 716.658725] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 716.673622] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 716.867049] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 723.176129] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 734.202642] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 738.381695] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 752.620470] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 752.635426] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 752.646992] Lustre: Skipped 2 previous similar messages [ 752.655038] Lustre: Skipped 4 previous similar messages [ 758.373559] Lustre: server umount lustre-MDT0000 complete [ 762.243678] LustreError: 26970:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785220270 with bad export cookie 8264518451053031014 [ 762.250907] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 762.256594] LustreError: 26970:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 7 previous similar messages [ 762.741864] Lustre: server umount lustre-MDT0001 complete [ 777.212319] Lustre: server umount lustre-OST0000 complete [ 778.207263] Lustre: 3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785220270/real 1785220270] req@ffff9e185070f100 x1871938462139904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785220286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 781.222430] Lustre: server umount lustre-OST0001 complete [ 799.473108] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 810.546565] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 811.222310] LustreError: 29021:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 811.232017] LustreError: 29021:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 811.342073] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 811.349925] Lustre: Skipped 3 previous similar messages [ 816.476323] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 827.013772] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 832.841228] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 835.777781] Lustre: 30170:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 842.679833] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 850.144922] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 852.335945] LustreError: 30525:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 852.370135] LustreError: 30525:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 859.466561] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 867.526234] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 876.275969] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 880.270926] Lustre: 32045:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 888.804270] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 888.815527] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 888.835802] Lustre: Skipped 2 previous similar messages [ 888.843402] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 888.851676] Lustre: Skipped 6 previous similar messages [ 892.826858] Lustre: server umount lustre-MDT0000 complete [ 896.996452] LustreError: 29002:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785220404 with bad export cookie 8264518451053032309 [ 897.001955] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 897.009099] LustreError: 29002:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 897.327962] Lustre: server umount lustre-MDT0001 complete [ 912.116511] Lustre: server umount lustre-OST0000 complete [ 926.320131] Lustre: server umount lustre-OST0001 complete [ 936.100179] Lustre: DEBUG MARKER: == conf-sanity test 76b: verify params log setup correctly ========================================================== 02:34:02 (1785220442) [ 965.837559] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 976.844962] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 977.311509] LustreError: 34849:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 977.325451] LustreError: 34849:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 6 previous similar messages [ 982.266935] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 991.618583] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 996.870023] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1000.101117] Lustre: 36002:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1006.469752] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1013.419687] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1023.084264] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1029.246404] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1036.930749] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1040.323475] Lustre: 37877:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1048.544947] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1048.557374] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1048.573294] Lustre: Skipped 3 previous similar messages [ 1048.588347] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1048.590853] Lustre: Skipped 4 previous similar messages [ 1050.571663] Lustre: server umount lustre-MDT0000 complete [ 1054.117216] LustreError: 34831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785220561 with bad export cookie 8264518451053033415 [ 1054.120766] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1054.127748] LustreError: 34831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1054.567828] Lustre: server umount lustre-MDT0001 complete [ 1061.021767] Lustre: server umount lustre-OST0000 complete [ 1065.200456] Lustre: server umount lustre-OST0001 complete [ 1073.842473] Lustre: DEBUG MARKER: == conf-sanity test 76c: verify changelog_mask is applied with lctl set_param -P ========================================================== 02:36:20 (1785220580) [ 1089.184858] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 1098.740207] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1099.079209] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1099.091825] Lustre: Skipped 7 previous similar messages [ 1103.267616] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1108.451371] LustreError: 40019:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1108.480485] LustreError: 40019:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 10 previous similar messages [ 1110.863707] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1115.814291] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1118.747661] Lustre: 41168:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1125.827937] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1132.848952] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1140.730295] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1148.547605] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1155.596763] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1158.744913] Lustre: 43046:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 1159.643740] Lustre: Setting parameter general.mdd.*.changelog_mask=-CLOSE in log params [ 1159.647772] Lustre: Skipped 1 previous similar message [ 1162.209274] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1168.353136] Lustre: server umount lustre-MDT0000 complete [ 1171.583309] LustreError: 39998:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785220679 with bad export cookie 8264518451053034521 [ 1171.591572] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1171.601185] LustreError: 39998:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 1178.093163] Lustre: server umount lustre-MDT0001 complete [ 1186.422723] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1200.873790] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1207.282691] Lustre: lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [ 1208.775249] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1213.685469] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1214.454686] Lustre: lustre-MDT0001-lwp-OST0001: Connection restored to 0@lo (at 0@lo) [ 1214.467115] Lustre: Skipped 1 previous similar message [ 1221.260328] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1222.936752] Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1228.652975] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1230.247191] Lustre: DEBUG MARKER: mdc.lustre-MDT0001-mdc-*.mds_server_uuid in FULL state after 0 sec [ 1234.915293] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1234.921307] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1234.942757] Lustre: Skipped 13 previous similar messages [ 1240.710448] Lustre: server umount lustre-MDT0000 complete [ 1245.169355] LustreError: 39999:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785220753 with bad export cookie 8264518451053035648 [ 1245.186386] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1245.188967] LustreError: 39999:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 1245.849787] Lustre: server umount lustre-MDT0001 complete [ 1259.578160] Lustre: server umount lustre-OST0000 complete [ 1272.453594] Lustre: server umount lustre-OST0001 complete [ 1281.153425] Lustre: DEBUG MARKER: == conf-sanity test 76d: verify llite.*.xattr_cache can be set by 'lctl set_param -P' correctly ========================================================== 02:39:47 (1785220787) [ 1295.323817] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 1304.118222] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1307.662584] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1314.381386] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1318.357694] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1320.529631] Lustre: 48804:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 1325.959696] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1330.681300] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1336.757945] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1342.184927] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1349.142389] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 1353.363497] Lustre: Setting parameter general.llite.*.xattr_cache=0 in log params [ 1365.990764] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1366.005268] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1366.013499] Lustre: Skipped 28 previous similar messages [ 1370.089090] Lustre: server umount lustre-MDT0000 complete [ 1371.110285] LustreError: 47652:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1371.124466] LustreError: 47652:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 37 previous similar messages [ 1373.205391] LustreError: 49996:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785220881 with bad export cookie 8264518451053036446 [ 1373.215296] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1373.554271] Lustre: server umount lustre-MDT0001 complete [ 1387.033258] Lustre: server umount lustre-OST0000 complete [ 1400.701114] Lustre: server umount lustre-OST0001 complete [ 1409.809587] Lustre: DEBUG MARKER: == conf-sanity test 77: comma-separated MGS NIDs and failover node NIDs ========================================================== 02:41:56 (1785220916) [ 1412.175177] Lustre: DEBUG MARKER: SKIP: conf-sanity test_77 mixed loopback and real device not working [ 1413.773731] Lustre: DEBUG MARKER: == conf-sanity test 78: run resize2fs on MDT and OST filesystems ========================================================== 02:42:00 (1785220920) [ 1423.371642] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 1430.189172] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 1448.381693] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1448.674301] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1448.758274] Lustre: lustre-MDT0000: new disk, initializing [ 1448.828674] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1453.469483] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1462.353867] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1468.262843] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1468.517166] Lustre: lustre-OST0000: new disk, initializing [ 1468.519609] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1468.522297] Lustre: Skipped 1 previous similar message [ 1468.526429] Lustre: 54880:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1469.764337] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 1469.772689] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 1469.801066] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 1474.168116] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1481.842624] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1483.753359] Lustre: DEBUG MARKER: create test files [ 1510.880995] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1510.889855] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1510.898908] Lustre: Skipped 5 previous similar messages [ 1513.751326] Lustre: server umount lustre-OST0000 complete [ 1516.380667] Lustre: server umount lustre-MDT0000 complete [ 1523.056469] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 1525.255899] Key type lgssc unregistered [ 1525.467141] LNet: 56513:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1525.474310] LNetError: 56513:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1525.487876] LNet: Removed LNI 192.168.202.131@tcp [ 1526.241450] Key type .llcrypt unregistered [ 1526.244331] Key type ._llcrypt unregistered [ 1547.728726] Key type ._llcrypt registered [ 1547.731441] Key type .llcrypt registered [ 1547.804460] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 1548.656569] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1548.749817] alg: No test for adler32 (adler32-zlib) [ 1549.843236] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 1550.041387] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 1551.697891] Key type lgssc registered [ 1552.665816] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1559.222296] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1559.249578] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1560.649138] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1564.173418] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1569.770673] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1575.279603] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1575.535069] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1580.739245] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1585.779865] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:100 to 0x240000400:129) [ 1585.869524] Lustre: 59223:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 511 < left 544, rollback = 9 [ 1585.873128] Lustre: 59223:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/4, destroy: 0/0/0 [ 1585.876236] Lustre: 59223:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1585.880418] Lustre: 59223:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1585.887323] Lustre: 59223:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1585.892989] Lustre: 59223:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1586.576793] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1591.100104] Lustre: DEBUG MARKER: check files after expanding the MDT and OST filesystems [ 1594.797433] Lustre: DEBUG MARKER: create more files after expanding the MDT and OST filesystems [ 1601.504608] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1601.517309] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1605.807441] Lustre: server umount lustre-OST0000 complete [ 1608.576637] Lustre: server umount lustre-MDT0000 complete [ 1617.359978] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 1619.574871] Key type lgssc unregistered [ 1619.878043] LNet: 60832:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1619.887582] LNetError: 60832:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1619.911853] LNet: Removed LNI 192.168.202.131@tcp [ 1620.559716] Key type .llcrypt unregistered [ 1620.561601] Key type ._llcrypt unregistered [ 1644.622837] Key type ._llcrypt registered [ 1644.624935] Key type .llcrypt registered [ 1644.721923] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 1645.832324] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1645.858431] alg: No test for adler32 (adler32-zlib) [ 1646.846748] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 1647.095190] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 1648.775181] Key type lgssc registered [ 1649.573894] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1655.328960] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1655.352595] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1656.718365] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1660.484683] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1666.647890] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1672.903110] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1673.195951] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1679.054725] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1681.397787] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:140 to 0x240000400:161) [ 1681.485877] Lustre: 63643:0:(osd_internal.h:1461:osd_trans_exec_op()) lustre-OST0000: opcode 8: before 509 < left 544, rollback = 9 [ 1681.491261] Lustre: 63643:0:(osd_handler.c:2090:osd_trans_dump_creds()) create: 32/128/6, destroy: 0/0/0 [ 1681.496426] Lustre: 63643:0:(osd_handler.c:2097:osd_trans_dump_creds()) attr_set: 0/0/0, xattr_set: 0/0/0 [ 1681.501449] Lustre: 63643:0:(osd_handler.c:2107:osd_trans_dump_creds()) write: 2/18/1, punch: 0/0/0, quota 1/3/0 [ 1681.506851] Lustre: 63643:0:(osd_handler.c:2114:osd_trans_dump_creds()) insert: 32/544/0, delete: 0/0/0 [ 1681.518733] Lustre: 63643:0:(osd_handler.c:2121:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0 [ 1686.232612] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1691.572701] Lustre: DEBUG MARKER: check files after shrinking the MDT and OST filesystems [ 1701.856539] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 1701.862924] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1701.872947] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1705.097663] Lustre: server umount lustre-OST0000 complete [ 1708.885735] Lustre: server umount lustre-MDT0000 complete [ 1720.302184] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 1722.556867] Key type lgssc unregistered [ 1722.781176] LNet: 65200:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 1722.785822] LNetError: 65200:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 1722.797308] LNet: Removed LNI 192.168.202.131@tcp [ 1723.695084] Key type .llcrypt unregistered [ 1723.698548] Key type ._llcrypt unregistered [ 1740.206734] Key type ._llcrypt registered [ 1740.208665] Key type .llcrypt registered [ 1740.353200] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 1757.173301] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 1758.658167] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 1758.696385] alg: No test for adler32 (adler32-zlib) [ 1759.727576] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 1759.961532] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 1761.631256] Key type lgssc registered [ 1762.855283] Lustre: Echo OBD driver; http://www.lustre.org/ [ 1794.791587] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 1794.812252] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1796.025638] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1796.049486] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1796.109197] Lustre: lustre-MDT0000: new disk, initializing [ 1796.155743] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1796.166844] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1799.745908] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1808.288939] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1808.405223] Lustre: 68352:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1808.457206] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1808.461165] Lustre: Skipped 1 previous similar message [ 1808.515803] Lustre: lustre-MDT0001: new disk, initializing [ 1808.599619] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1808.644156] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1808.651893] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1812.299741] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1821.261929] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 1826.321230] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 1832.619915] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 1832.820972] Lustre: lustre-OST0000: new disk, initializing [ 1832.824292] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 1832.827817] Lustre: 70318:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 1832.899381] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 1838.004599] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1840.189729] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 1840.202729] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 1840.309070] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 1847.652789] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 1852.227660] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 1852.477853] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 1857.161775] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 1857.360807] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 1861.091290] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1861.092848] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 1861.112678] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 1861.128975] Lustre: Skipped 1 previous similar message [ 1865.730217] Lustre: server umount lustre-OST0000 complete [ 1870.309497] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 1870.315363] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1870.327245] Lustre: Skipped 1 previous similar message [ 1870.334935] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1871.343419] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 1871.349763] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 1875.480482] Lustre: server umount lustre-MDT0000 complete [ 1879.073806] LustreError: 68346:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785221386 with bad export cookie 1679802664509354664 [ 1879.084962] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 1879.098845] LustreError: 68346:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 1879.611274] Lustre: server umount lustre-MDT0001 complete [ 1886.831786] Lustre: DEBUG MARKER: == conf-sanity test 79: format MDT/OST without mgs option (should return errors) ========================================================== 02:49:53 (1785221393) [ 1898.152352] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 1934.171849] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 1942.660229] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 1973.879819] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1974.097531] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 1974.124539] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 1974.203795] Lustre: lustre-MDT0000: new disk, initializing [ 1974.259292] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 1974.273451] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 1978.115311] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 1987.678378] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 1987.811616] Lustre: 76334:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 1987.853320] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 1987.856443] Lustre: Skipped 1 previous similar message [ 1987.917658] Lustre: lustre-MDT0001: new disk, initializing [ 1987.999383] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 1988.039599] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 1988.049427] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 1991.936807] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2001.198452] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2006.089580] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2010.894959] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2011.079460] Lustre: lustre-OST0000: new disk, initializing [ 2011.083441] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 2011.089860] Lustre: 78302:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2011.168545] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2016.677131] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2018.354652] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 2018.358718] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2018.432491] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2024.924194] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2028.608238] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2028.770989] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2032.701872] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2032.881354] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2034.154412] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2034.165739] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2034.171357] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2034.171365] Lustre: Skipped 1 previous similar message [ 2034.188956] Lustre: Skipped 1 previous similar message [ 2039.264371] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2039.282209] Lustre: Skipped 2 previous similar messages [ 2040.259645] Lustre: server umount lustre-OST0000 complete [ 2044.384542] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 2044.393246] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2044.409276] Lustre: Skipped 1 previous similar message [ 2049.511139] LustreError: 77229:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2049.520582] LustreError: 77229:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 2049.593137] Lustre: server umount lustre-MDT0000 complete [ 2052.698893] LustreError: 76328:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785221560 with bad export cookie 1679802664509355546 [ 2052.704910] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2052.709248] LustreError: 76328:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 2052.985871] Lustre: server umount lustre-MDT0001 complete [ 2060.392733] Lustre: DEBUG MARKER: == conf-sanity test 80: mgc import reconnect race ======== 02:52:47 (1785221567) [ 2066.237597] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2066.684548] LustreError: 80715:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2066.744503] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2071.297732] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2072.032846] LustreError: 80716:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2077.155468] LustreError: 80715:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2078.522796] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2082.745689] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2088.938967] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2094.094932] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2100.220674] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2100.645167] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2100.649416] Lustre: Skipped 1 previous similar message [ 2105.930198] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2112.382116] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2116.003560] Lustre: 83385:0:(genops.c:1795:obd_export_evict_by_uuid()) MGS: evicting 6e196f49-6098-4852-94c5-9f5e6ced5acc at adminstrative request [ 2118.120638] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2118.131148] Lustre: *** cfs_fail_loc=906, val=2147483648*** [ 2127.329813] Lustre: MGS: Client 6e196f49-6098-4852-94c5-9f5e6ced5acc (at 0@lo) reconnecting [ 2127.340989] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x174fdb9f96d5b98c to 0x174fdb9f96d5bc2c [ 2127.351084] Lustre: MGC192.168.202.131@tcp: Connection restored to 0@lo (at 0@lo) [ 2151.366928] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2151.505984] Lustre: lustre-OST0001: new disk, initializing [ 2151.511760] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2151.518590] Lustre: 83780:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2156.534787] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2159.185641] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2159.192995] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2159.298782] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2163.686883] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2169.826402] LustreError: lustre-OST0001-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2169.828221] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2169.839406] LustreError: Skipped 1 previous similar message [ 2169.840170] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [ 2169.840175] Lustre: Skipped 2 previous similar messages [ 2169.861763] Lustre: Skipped 1 previous similar message [ 2171.690783] Lustre: server umount lustre-OST0001 complete [ 2174.947278] LustreError: 82537:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2174.961157] LustreError: 82537:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 2179.556084] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 2185.203809] LustreError: 82537:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2185.223145] LustreError: 82537:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 2189.281938] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2189.500886] Lustre: server umount lustre-OST0000 complete [ 2195.431322] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2195.433160] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 2195.449961] Lustre: Skipped 3 previous similar messages [ 2195.462351] Lustre: Skipped 8 previous similar messages [ 2198.990976] Lustre: server umount lustre-MDT0000 complete [ 2201.855392] LustreError: 80696:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785221709 with bad export cookie 1679802664509357100 [ 2201.861197] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2201.863541] LustreError: 80696:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2202.189646] Lustre: server umount lustre-MDT0001 complete [ 2208.460542] Lustre: DEBUG MARKER: == conf-sanity test 81: sparse OST indexing ============== 02:55:15 (1785221715) [ 2209.454875] Lustre: DEBUG MARKER: SKIP: conf-sanity test_81 needs >= 3 OSTs [ 2210.483765] Lustre: DEBUG MARKER: == conf-sanity test 82a: specify OSTs for file (succeed) or directory (succeed) ========================================================== 02:55:17 (1785221717) [ 2211.426389] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82a needs >= 3 OSTs [ 2212.609357] Lustre: DEBUG MARKER: == conf-sanity test 82b: specify OSTs for file with --pool and --ost-list options ========================================================== 02:55:19 (1785221719) [ 2213.816173] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82b needs >= 4 OSTs [ 2214.965410] Lustre: DEBUG MARKER: == conf-sanity test 82c: specify sparse OSTs for setstripe (should not crash) ========================================================== 02:55:22 (1785221722) [ 2216.121237] Lustre: DEBUG MARKER: SKIP: conf-sanity test_82c needs >= 4 OSTs [ 2217.263526] Lustre: DEBUG MARKER: == conf-sanity test 83: ENOSPACE on OST doesn't cause message VFS: Busy inodes after unmount ... ========================================================== 02:55:24 (1785221724) [ 2218.274651] Lustre: DEBUG MARKER: mount the OST /dev/mapper/ost1_flakey as a ldiskfs filesystem [ 2221.881654] loop: module loaded [ 2221.887074] loop0: detected capacity change from 0 to 4294967296 [ 2221.933129] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 2222.842634] Lustre: DEBUG MARKER: run llverfs in partial mode on the OST ldiskfs /mnt/lustre-ost1 [ 2224.952305] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing run_llverfs /mnt/lustre-ost1 -vpl no [ 2227.642275] Lustre: DEBUG MARKER: unmount the OST /dev/mapper/ost1_flakey [ 2247.372985] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2247.399928] LustreError: 87899:0:(obd_config.c:845:class_setup()) setup lustre-OST0000-osd failed (-28) [ 2247.405175] LustreError: 87899:0:(obd_mount.c:259:lustre_start_simple()) lustre-OST0000-osd setup error -28 [ 2247.410219] LustreError: 87899:0:(tgt_mount.c:2579:server_fill_super()) Unable to start osd on /dev/mapper/ost1_flakey: -28 [ 2247.416463] LustreError: 87899:0:(super25.c:178:lustre_fill_super()) llite: Unable to mount : rc = -28 [ 2262.909426] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 2270.597479] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 2298.095885] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2298.339344] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2298.363468] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2298.423514] Lustre: lustre-MDT0000: new disk, initializing [ 2298.495985] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 2298.500214] Lustre: Skipped 1 previous similar message [ 2298.507900] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2302.252822] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2310.509312] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2310.622690] Lustre: 90763:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2310.823031] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2313.940450] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2320.737841] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2324.287704] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2329.242155] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2329.405461] Lustre: 92730:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2333.406594] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2335.274571] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 2335.334671] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2340.130247] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2342.888659] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2343.008072] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2345.671534] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2345.790474] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2350.560140] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2350.562824] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2350.566912] LustreError: Skipped 1 previous similar message [ 2350.571597] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2350.579954] Lustre: Skipped 1 previous similar message [ 2361.312031] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2361.411819] Lustre: server umount lustre-OST0000 complete [ 2378.207119] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2378.315828] Lustre: server umount lustre-MDT0000 complete [ 2380.741556] LustreError: 90756:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785221888 with bad export cookie 1679802664509357716 [ 2380.745232] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2380.749512] LustreError: 90756:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 2381.012690] Lustre: server umount lustre-MDT0001 complete [ 2386.229590] Lustre: DEBUG MARKER: == conf-sanity test 84: check recovery_hard_time ========= 02:58:13 (1785221893) [ 2390.161528] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2390.395481] LustreError: 95143:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2390.402206] LustreError: 95143:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 2392.552827] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2397.240369] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2399.895733] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2404.316858] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2408.196344] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2412.413361] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2417.843199] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2428.453480] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2435.077159] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2435.336087] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2444.583897] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2445.033147] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2457.319183] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2457.662637] Lustre: lustre-OST0001: new disk, initializing [ 2457.670433] Lustre: Skipped 2 previous similar messages [ 2457.689919] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 2457.703724] Lustre: Skipped 3 previous similar messages [ 2457.727344] Lustre: 98517:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2457.951546] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 2457.980216] Lustre: Skipped 5 previous similar messages [ 2463.341021] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 2463.352079] Lustre: Skipped 2 previous similar messages [ 2463.363064] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 2463.568747] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 2469.253956] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2484.158278] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2491.348763] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50 [ 2491.689388] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2497.303619] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [ 2497.651567] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2518.940726] Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 [ 2541.277065] Lustre: Failing over lustre-MDT0000 [ 2541.786333] Lustre: server umount lustre-MDT0000 complete [ 2545.632874] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2545.643815] Lustre: Skipped 2 previous similar messages [ 2545.655461] LustreError: 95877:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2545.671841] LustreError: 95877:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [ 2562.016602] Lustre: 66577:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785222053/real 1785222053] req@000000007d1a26a4 x1871940175534464/t0(0) o400->MGC192.168.202.131@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1785222069 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 [ 2562.031142] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2566.955205] LDISKFS-fs (dm-0): 4 truncates cleaned up [ 2566.960865] LDISKFS-fs (dm-0): recovery complete [ 2566.972986] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2571.242128] Lustre: Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x174fdb9f96d686a0 [ 2571.247029] Lustre: MGC192.168.202.131@tcp: Connection restored to 0@lo (at 0@lo) [ 2571.580751] Lustre: lustre-MDT0000: in recovery but waiting for the first client to connect [ 2572.670136] Lustre: lustre-MDT0000: Will be in recovery for at least 1:00, or until 3 clients reconnect [ 2572.680601] Lustre: 95139:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2575.910344] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2576.881318] Lustre: 95871:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 0 [ 2576.892975] Lustre: 95871:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 1 previous similar message [ 2576.914600] Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2576.999443] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2577.336077] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2577.672199] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2577.690601] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 1 previous similar message [ 2578.024068] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2578.032050] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 1 previous similar message [ 2578.038563] Lustre: 101378:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2578.051064] Lustre: 101378:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 7 previous similar messages [ 2578.681945] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2578.695753] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 2 previous similar messages [ 2579.335220] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2579.346110] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 3 previous similar messages [ 2580.321545] Lustre: 101378:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2580.353206] Lustre: 101378:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 6 previous similar messages [ 2580.688278] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2580.696790] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 5 previous similar messages [ 2581.351897] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2581.364186] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 5 previous similar messages [ 2584.537324] Lustre: 101378:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2584.552072] Lustre: 101378:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 12 previous similar messages [ 2584.879461] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2584.891302] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 12 previous similar messages [ 2585.543230] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2585.561723] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 12 previous similar messages [ 2592.561031] Lustre: 101378:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2592.583912] Lustre: 101378:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 24 previous similar messages [ 2592.908371] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2592.923938] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 24 previous similar messages [ 2593.559171] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2593.571239] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 24 previous similar messages [ 2608.729491] Lustre: 101378:0:(ldlm_lib.c:2084:extend_recovery_timer()) lustre-MDT0000: extended recovery timer reached hard limit: 60, extend: 1 [ 2608.740091] Lustre: 101378:0:(ldlm_lib.c:2084:extend_recovery_timer()) Skipped 50 previous similar messages [ 2609.074747] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 sleeping for 300ms [ 2609.105222] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 50 previous similar messages [ 2609.743133] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) cfs_fail_timeout id 709 awake [ 2609.751932] LustreError: 101378:0:(ldlm_lib.c:2697:replay_request_or_update()) Skipped 50 previous similar messages [ 2632.247221] Lustre: 101378:0:(ldlm_lib.c:2393:target_recovery_overseer()) lustre-MDT0000 recovery is aborted by hard timeout [ 2632.252888] Lustre: 101378:0:(ldlm_lib.c:2403:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2632.261749] Lustre: 101378:0:(genops.c:1622:class_disconnect_stale_exports()) lustre-MDT0000: disconnect stale client ec50d5e6-b669-4eba-afbe-fe189b2480d4@192.168.202.31@tcp [ 2632.268039] Lustre: lustre-MDT0000: disconnecting 1 stale clients [ 2632.271095] Lustre: 101378:0:(ldlm_lib.c:1913:abort_req_replay_queue()) @@@ aborted: req@000000007ad2764d x1871940158557312/t0(8589934770) o35->ec50d5e6-b669-4eba-afbe-fe189b2480d4@192.168.202.31@tcp:490/0 lens 392/0 e 0 to 0 dl 1785222150 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:0 [ 2632.289188] Lustre: lustre-MDT0000-osd: cancel update llog [0x200000400:0x1:0x0] [ 2632.304061] Lustre: lustre-MDT0000: Denying connection for new client ec50d5e6-b669-4eba-afbe-fe189b2480d4 (at 192.168.202.31@tcp), waiting for 3 known clients (2 recovered, 0 in progress, and 1 evicted) to recover in 0:00 [ 2632.318202] Lustre: lustre-MDT0001-osp-MDT0000: cancel update llog [0x240000401:0x1:0x0] [ 2632.382275] Lustre: lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) [ 2632.384606] Lustre: Skipped 2 previous similar messages [ 2632.397437] Lustre: lustre-MDT0000: Recovery over after 1:00, of 3 clients 2 recovered and 1 was evicted. [ 2632.447151] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:46 to 0x2c0000401:545) [ 2632.463773] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:77 to 0x280000401:577) [ 2648.561076] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2648.567085] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2648.575813] Lustre: Skipped 12 previous similar messages [ 2659.296045] Lustre: lustre-OST0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 2659.423092] Lustre: server umount lustre-OST0000 complete [ 2663.904510] LustreError: 96964:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2663.922310] LustreError: 96964:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 37 previous similar messages [ 2668.793815] Lustre: server umount lustre-OST0001 complete [ 2673.639877] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2673.652414] Lustre: Skipped 4 previous similar messages [ 2678.569728] Lustre: server umount lustre-MDT0000 complete [ 2681.768396] LustreError: 98516:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785222189 with bad export cookie 1679802664509408928 [ 2681.776708] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2681.779144] LustreError: 98516:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2682.040526] Lustre: server umount lustre-MDT0001 complete [ 2689.988088] Lustre: DEBUG MARKER: == conf-sanity test 85: osd_ost init: fail ea_fid_set ==== 03:03:16 (1785222196) [ 2697.296278] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2697.303291] Lustre: *** cfs_fail_loc=197, val=0*** [ 2712.863624] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 2717.983600] LustreError: 103353:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.131@tcp: failed processing log, type 4: rc = -110 [ 2723.150147] Lustre: *** cfs_fail_loc=197, val=0*** [ 2723.154940] Lustre: Skipped 65 previous similar messages [ 2743.711270] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 2743.722624] Lustre: Skipped 1 previous similar message [ 2749.250086] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2755.752220] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2757.636078] Lustre: server umount lustre-OST0000 complete [ 2765.544859] Lustre: DEBUG MARKER: == conf-sanity test 86: Replacing mkfs.lustre -G option == 03:04:32 (1785222272) [ 2786.088854] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2791.383467] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2791.915723] LustreError: 104976:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2791.931488] LustreError: 104976:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 2799.875762] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2803.275870] LustreError: 105007:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0001-osp-MDT0000: osp_attr_get update error [0x200000009:0x1:0x0]: rc = -5 [ 2803.289895] LustreError: 105007:0:(lod_sub_object.c:917:lod_sub_prep_llog()) lustre-MDT0000-mdtlov: can't get id from catalogs: rc = -5 [ 2803.303504] LustreError: 105007:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 17, retries 0, failed: rc = -5 [ 2803.577145] Lustre: server umount lustre-MDT0000 complete [ 2831.190837] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 2840.580849] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 2872.199422] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2872.364387] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 2872.385172] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 2872.455727] Lustre: lustre-MDT0000: new disk, initializing [ 2872.505914] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 2876.512031] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2886.252030] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 2886.364329] Lustre: 109178:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 2886.642115] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 2890.432984] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2899.069928] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 2903.417882] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 2909.570319] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2909.738987] Lustre: 111148:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 2915.129556] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 2915.929397] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 2923.478620] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 2927.465775] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 2927.623366] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 2931.457857] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 2931.616913] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 2936.291351] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 2936.291660] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 2936.300379] LustreError: Skipped 4 previous similar messages [ 2936.309983] Lustre: Skipped 1 previous similar message [ 2936.320084] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 2936.320108] Lustre: Skipped 9 previous similar messages [ 2939.285601] Lustre: server umount lustre-OST0000 complete [ 2948.587304] Lustre: server umount lustre-MDT0000 complete [ 2951.843594] LustreError: 109168:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785222459 with bad export cookie 1679802664509419526 [ 2951.850506] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 2951.858420] LustreError: 109168:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 2952.125502] Lustre: server umount lustre-MDT0001 complete [ 2958.607586] Lustre: DEBUG MARKER: == conf-sanity test 87: check if MDT inode can hold EAs with N stripes properly ========================================================== 03:07:45 (1785222465) [ 2967.007245] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 2969.254866] Key type lgssc unregistered [ 2969.465100] LNet: 113633:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 2969.468539] LNetError: 113633:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 2969.496031] LNet: Removed LNI 192.168.202.131@tcp [ 2970.198570] Key type .llcrypt unregistered [ 2970.201466] Key type ._llcrypt unregistered [ 2984.423713] Key type ._llcrypt registered [ 2984.425180] Key type .llcrypt registered [ 2984.518337] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 2996.876979] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 2997.774095] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 2997.801321] alg: No test for adler32 (adler32-zlib) [ 2998.793525] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 2998.973737] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 3000.619699] Key type lgssc registered [ 3001.485761] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3034.698983] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3034.715033] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3035.904263] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3035.945873] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3036.026751] Lustre: lustre-MDT0000: new disk, initializing [ 3036.105459] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3036.119519] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3039.495898] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3048.046973] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3048.299859] Lustre: lustre-OST0000: new disk, initializing [ 3048.303823] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3048.308792] Lustre: Skipped 1 previous similar message [ 3048.314485] Lustre: 117791:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3048.392949] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3051.959894] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 3051.971133] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 3052.019499] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 3053.048374] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3062.946631] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3063.052938] Lustre: lustre-OST0001: new disk, initializing [ 3063.056470] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 3063.062216] Lustre: 118654:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3063.151222] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 3068.757480] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3070.638465] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost [ 3070.644805] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] [ 3070.677720] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 [ 3081.184401] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3081.199279] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3082.489898] Lustre: server umount lustre-MDT0000 complete [ 3088.632431] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null) [ 3093.122262] LustreError: 116978:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785222600 with bad export cookie 6454632733773670148 [ 3093.132072] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3093.135879] LustreError: 116978:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 3093.319229] Lustre: server umount lustre-OST0000 complete [ 3096.891646] Lustre: server umount lustre-OST0001 complete [ 3103.921515] Lustre: DEBUG MARKER: == conf-sanity test 88a: tunefs.lustre persists a --mountfsoptions-only change ========================================================== 03:10:10 (1785222610) [ 3123.619673] Lustre: DEBUG MARKER: == conf-sanity test 88b: check the default mount options can be overridden ========================================================== 03:10:30 (1785222630) [ 3133.310742] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 3151.557267] Lustre: DEBUG MARKER: == conf-sanity test 89: check tunefs --param and --erase-param{s} options ========================================================== 03:10:58 (1785222658) [ 3184.387352] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 3192.379326] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 3220.724713] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3220.906198] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 3220.925841] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 3220.996259] Lustre: lustre-MDT0000: new disk, initializing [ 3221.054910] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3221.074144] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 3224.660097] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3232.525331] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3232.588956] Lustre: 126406:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 3232.631649] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 3232.637960] Lustre: Skipped 1 previous similar message [ 3232.703288] Lustre: lustre-MDT0001: new disk, initializing [ 3232.782247] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3232.818508] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 3232.831784] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 3236.396904] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3243.918240] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3248.750779] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL failover.node=192.0.2.254@tcp0,mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3254.843765] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3255.016864] Lustre: lustre-OST0000: new disk, initializing [ 3255.018917] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 3255.022906] Lustre: 128373:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 3255.067400] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3259.758535] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3262.004653] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 3262.017137] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 3262.120497] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 3267.730257] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) failover.node=192.0.2.254@tcp0,osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3272.006720] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 3272.220689] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 3276.341332] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 3276.525889] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 3282.920096] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3282.924159] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3282.925552] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3282.928772] Lustre: Skipped 2 previous similar messages [ 3282.962781] Lustre: Skipped 2 previous similar messages [ 3284.382524] Lustre: server umount lustre-OST0000 complete [ 3288.035706] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3288.047402] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3288.049399] Lustre: Skipped 1 previous similar message [ 3288.060994] Lustre: Skipped 1 previous similar message [ 3293.153801] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3293.159767] Lustre: Skipped 1 previous similar message [ 3293.439233] Lustre: server umount lustre-MDT0000 complete [ 3296.769471] LustreError: 128372:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785222804 with bad export cookie 6454632733773671373 [ 3296.779050] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3297.019945] Lustre: server umount lustre-MDT0001 complete [ 3304.440665] Lustre: DEBUG MARKER: == conf-sanity test 90a: check max_mod_rpcs_in_flight is enforced ========================================================== 03:13:31 (1785222811) [ 3309.799255] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3310.138385] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3313.966807] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3315.170915] LustreError: 130785:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3315.182427] LustreError: 130785:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 3319.270140] LustreError: 130784:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3320.725570] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3325.259749] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3331.063709] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3335.601268] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3341.102493] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3346.454538] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3352.552144] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3361.250715] Lustre: *** cfs_fail_loc=159, val=0*** [ 3377.557732] Lustre: lustre-MDT0000: Client 487908b4-0e23-48e1-8963-bc57d9a4fd1a (at 192.168.202.31@tcp) reconnecting [ 3379.005976] Lustre: *** cfs_fail_loc=159, val=0*** [ 3379.007634] Lustre: Skipped 5 previous similar messages [ 3395.497585] Lustre: lustre-MDT0000: Client 487908b4-0e23-48e1-8963-bc57d9a4fd1a (at 192.168.202.31@tcp) reconnecting [ 3400.681839] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3400.683285] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3400.686106] LustreError: Skipped 1 previous similar message [ 3400.687105] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3400.718855] Lustre: Skipped 1 previous similar message [ 3401.614220] Lustre: server umount lustre-OST0000 complete [ 3405.794090] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3410.915300] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3410.923144] Lustre: Skipped 4 previous similar messages [ 3411.311844] Lustre: server umount lustre-MDT0000 complete [ 3414.352935] LustreError: 130764:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785222922 with bad export cookie 6454632733773672255 [ 3414.362319] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3414.374252] LustreError: 130764:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 8 previous similar messages [ 3414.682106] Lustre: server umount lustre-MDT0001 complete [ 3423.051464] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 3425.180318] Key type lgssc unregistered [ 3425.374756] LNet: 134555:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3425.382421] LNetError: 134555:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3425.394489] LNet: Removed LNI 192.168.202.131@tcp [ 3426.049323] Key type .llcrypt unregistered [ 3426.052235] Key type ._llcrypt unregistered [ 3444.016394] Key type ._llcrypt registered [ 3444.018287] Key type .llcrypt registered [ 3444.101443] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 3445.243435] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3445.266759] alg: No test for adler32 (adler32-zlib) [ 3446.191765] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 3446.376626] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 3448.023328] Key type lgssc registered [ 3448.949722] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3454.809846] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3454.824382] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3456.142361] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3459.244333] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3465.190593] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3465.386914] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3467.615347] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3474.138135] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3478.950319] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3483.955260] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3484.237638] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3488.579252] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3493.792826] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3501.681962] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:42 to 0x280000401:65) [ 3514.524505] Lustre: *** cfs_fail_loc=159, val=0*** [ 3530.200110] Lustre: lustre-MDT0000: Client 738bc921-2613-4382-a4ed-1804c5792cd2 (at 192.168.202.31@tcp) reconnecting [ 3533.246188] Lustre: *** cfs_fail_loc=159, val=0*** [ 3533.258456] Lustre: Skipped 2 previous similar messages [ 3549.621276] Lustre: lustre-MDT0001: Client 738bc921-2613-4382-a4ed-1804c5792cd2 (at 192.168.202.31@tcp) reconnecting [ 3552.235046] Lustre: *** cfs_fail_loc=159, val=0*** [ 3552.250799] Lustre: Skipped 2 previous similar messages [ 3568.606927] Lustre: lustre-MDT0001: Client 738bc921-2613-4382-a4ed-1804c5792cd2 (at 192.168.202.31@tcp) reconnecting [ 3574.588695] Lustre: 139019:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3577.599706] Lustre: *** cfs_fail_loc=159, val=0*** [ 3577.608858] Lustre: Skipped 3 previous similar messages [ 3593.128368] Lustre: lustre-MDT0000: Client 86d0e493-2b61-4dca-8825-34160a0b2bfa (at 192.168.202.31@tcp) reconnecting [ 3594.853433] Lustre: *** cfs_fail_loc=159, val=0*** [ 3594.855069] Lustre: Skipped 14 previous similar messages [ 3609.988583] Lustre: lustre-MDT0000: Client 86d0e493-2b61-4dca-8825-34160a0b2bfa (at 192.168.202.31@tcp) reconnecting [ 3611.581678] Lustre: 139314:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3617.773525] LustreError: lustre-OST0000-osc-MDT0001: operation ost_destroy to node 0@lo failed: rc = -107 [ 3617.774421] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3617.791640] LustreError: Skipped 1 previous similar message [ 3617.827659] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3619.818056] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3619.822662] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3619.836794] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3619.836802] LustreError: Skipped 4 previous similar messages [ 3619.870721] Lustre: Skipped 1 previous similar message [ 3623.062455] Lustre: server umount lustre-OST0000 complete [ 3629.536226] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 3629.544095] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3629.553298] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3633.304250] Lustre: server umount lustre-MDT0000 complete [ 3635.168708] LustreError: 138739:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3635.191149] LustreError: 138739:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 3637.304123] LustreError: 139141:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785223145 with bad export cookie 7530967513505582838 [ 3637.308483] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3637.320057] LustreError: 139141:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 3637.621211] Lustre: server umount lustre-MDT0001 complete [ 3648.624625] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 3651.434785] Key type lgssc unregistered [ 3651.790896] LNet: 140366:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3651.805466] LNetError: 140366:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3651.829752] LNet: Removed LNI 192.168.202.131@tcp [ 3652.859606] Key type .llcrypt unregistered [ 3652.862334] Key type ._llcrypt unregistered [ 3674.983512] Key type ._llcrypt registered [ 3674.985432] Key type .llcrypt registered [ 3675.046866] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 3675.873835] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3675.950846] alg: No test for adler32 (adler32-zlib) [ 3676.990347] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 3677.209167] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 3678.919189] Key type lgssc registered [ 3680.146537] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3688.402967] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3688.434193] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3690.083360] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3695.243966] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3699.715524] LustreError: 141779:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3699.740064] LustreError: 141779:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 3704.135967] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3704.591518] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3709.616287] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3718.088303] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3724.230461] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3730.922832] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3731.298048] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3734.412927] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:129) [ 3737.662861] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3745.391798] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3749.756123] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:97) [ 3755.251373] Lustre: 144361:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3757.915104] Lustre: 144410:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3759.311255] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 in log params [ 3760.226554] Lustre: Setting parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=8 in log params [ 3764.002883] Lustre: 144556:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre/mdc.lustre-MDT0000-mdc-*.max_rpcs_in_flight=8 (mode = 0) failed: rc = -17 [ 3764.937618] Lustre: Modifying parameter lustre.mdc.lustre-MDT0000-mdc-*.max_mod_rpcs_in_flight=7 in log params [ 3765.855933] Lustre: 144654:0:(mdt_handler.c:64:mdt_max_mod_rpcs_per_client_set()) max_mod_rpcs_per_client is deprecated, set mdt.*.max_mod_rpcs_in_flight parameter instead [ 3770.340812] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 3770.342253] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3770.361976] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3770.368952] Lustre: Skipped 1 previous similar message [ 3770.390520] Lustre: Skipped 1 previous similar message [ 3775.458831] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3775.465944] Lustre: Skipped 1 previous similar message [ 3775.889577] Lustre: server umount lustre-OST0000 complete [ 3780.581871] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3780.589501] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3780.605430] Lustre: Skipped 1 previous similar message [ 3780.618527] Lustre: Skipped 1 previous similar message [ 3785.710205] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3785.714719] Lustre: Skipped 1 previous similar message [ 3785.876271] Lustre: server umount lustre-MDT0000 complete [ 3789.594959] LustreError: 141759:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785223297 with bad export cookie 12898197116790850632 [ 3789.602700] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3790.033961] Lustre: server umount lustre-MDT0001 complete [ 3801.147309] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 3804.515097] Key type lgssc unregistered [ 3804.750271] LNet: 145716:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3804.757150] LNetError: 145716:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3804.770627] LNet: Removed LNI 192.168.202.131@tcp [ 3806.080838] Key type .llcrypt unregistered [ 3806.086881] Key type ._llcrypt unregistered [ 3831.655480] Key type ._llcrypt registered [ 3831.657662] Key type .llcrypt registered [ 3831.774139] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 3833.256457] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 3833.294805] alg: No test for adler32 (adler32-zlib) [ 3834.390672] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 3834.599186] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 3836.279218] Key type lgssc registered [ 3837.416389] Lustre: Echo OBD driver; http://www.lustre.org/ [ 3845.020935] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 3845.036041] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3846.677882] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 3851.323889] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3856.866472] LustreError: 147131:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3856.878129] LustreError: 147131:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 3860.411891] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 3860.897116] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 3865.921848] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3874.341947] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 3880.479592] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 3888.787728] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 3889.405715] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 3891.458115] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:85 to 0x280000401:161) [ 3896.682538] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 3904.136239] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 3905.791919] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:129) [ 3911.577528] Lustre: *** cfs_fail_loc=159, val=0*** [ 3927.962494] Lustre: lustre-MDT0000: Client 2fd35b90-317e-4e93-91fa-7e757c2cf666 (at 192.168.202.31@tcp) reconnecting [ 3946.989772] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3946.992417] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 3947.001604] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 3950.659647] Lustre: server umount lustre-OST0000 complete [ 3957.218238] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 3957.231943] Lustre: Skipped 1 previous similar message [ 3957.239442] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 3957.255505] Lustre: Skipped 2 previous similar messages [ 3960.745505] Lustre: server umount lustre-MDT0000 complete [ 3962.339770] LustreError: 147132:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 3962.354796] LustreError: 147132:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 3964.594881] LustreError: 147111:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785223472 with bad export cookie 4802519130884168167 [ 3964.599088] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 3964.601099] LustreError: 147111:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 3964.994668] Lustre: server umount lustre-MDT0001 complete [ 3975.938589] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 3978.657382] Key type lgssc unregistered [ 3978.936552] LNet: 150800:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 3978.943100] LNetError: 150800:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 3978.960956] LNet: Removed LNI 192.168.202.131@tcp [ 3979.903915] Key type .llcrypt unregistered [ 3979.906538] Key type ._llcrypt unregistered [ 4003.364351] Key type ._llcrypt registered [ 4003.365687] Key type .llcrypt registered [ 4003.450224] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 4004.469959] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4004.552405] alg: No test for adler32 (adler32-zlib) [ 4005.753700] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 4006.024912] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 4007.687175] Key type lgssc registered [ 4008.902604] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4016.893610] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4016.906246] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4018.380804] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4023.147960] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4028.900932] LustreError: 152216:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4028.923542] LustreError: 152216:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 4030.624395] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4031.047030] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4035.927724] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4045.612109] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4052.523464] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4059.200648] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4059.523026] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4063.608696] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:170 to 0x280000401:193) [ 4066.288077] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4073.548357] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4075.906083] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:161) [ 4097.622210] Lustre: lustre-MDT0001: evicting 5f90940b-2b55-4895-8143-7f2c18806fb2 (at 192.168.202.31@tcp) by administrative request [ 4097.631423] Lustre: Skipped 1 previous similar message [ 4125.152688] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 4125.162051] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4125.176359] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4127.203801] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4127.206530] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4127.213298] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4127.244408] Lustre: Skipped 1 previous similar message [ 4131.356102] Lustre: server umount lustre-OST0000 complete [ 4137.441894] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4137.455868] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4137.463261] Lustre: Skipped 1 previous similar message [ 4141.106414] Lustre: server umount lustre-MDT0000 complete [ 4142.561250] LustreError: 152216:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4142.572788] LustreError: 152216:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 4145.140075] LustreError: 154912:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785223652 with bad export cookie 3798010843921709309 [ 4145.144909] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4145.149680] LustreError: 154912:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 4145.588605] Lustre: server umount lustre-MDT0001 complete [ 4158.429332] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 4160.913062] Key type lgssc unregistered [ 4161.236699] LNet: 156289:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4161.246575] LNetError: 156289:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4161.273436] LNet: Removed LNI 192.168.202.131@tcp [ 4162.159648] Key type .llcrypt unregistered [ 4162.161618] Key type ._llcrypt unregistered [ 4240.295538] Key type ._llcrypt registered [ 4240.298352] Key type .llcrypt registered [ 4240.421505] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 4241.825657] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4241.856517] alg: No test for adler32 (adler32-zlib) [ 4243.174614] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 4243.609215] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 4245.384393] Key type lgssc registered [ 4246.914199] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4255.601423] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4255.617625] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4257.066242] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4261.996518] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4266.470701] LustreError: 158778:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4266.499240] LustreError: 158778:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 4271.163286] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4271.566696] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4276.059257] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4283.213021] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4289.480673] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4296.185947] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4296.595068] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4301.764487] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:195 to 0x280000401:225) [ 4303.177230] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4310.685504] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4317.110074] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:72 to 0x280000400:193) [ 4324.860236] LustreError: lustre-OST0000-osc-MDT0000: operation ost_destroy to node 0@lo failed: rc = -107 [ 4324.870537] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4324.892928] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4327.395461] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4327.400920] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4327.428581] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4330.327286] Lustre: server umount lustre-OST0000 complete [ 4337.632890] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4337.648928] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4337.654916] Lustre: Skipped 1 previous similar message [ 4340.761931] Lustre: server umount lustre-MDT0000 complete [ 4342.754583] LustreError: 161278:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 4342.778138] LustreError: 161278:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 4344.642067] LustreError: 158759:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785223852 with bad export cookie 4633957506875732574 [ 4344.648645] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4344.653503] LustreError: 158759:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4345.091782] Lustre: server umount lustre-MDT0001 complete [ 4356.713681] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 4360.108302] Key type lgssc unregistered [ 4360.533819] LNet: 162343:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4360.544657] LNetError: 162343:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4360.572042] LNet: Removed LNI 192.168.202.131@tcp [ 4361.738924] Key type .llcrypt unregistered [ 4361.741716] Key type ._llcrypt unregistered [ 4385.264599] Key type ._llcrypt registered [ 4385.267454] Key type .llcrypt registered [ 4385.378901] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 4386.757244] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4386.824370] alg: No test for adler32 (adler32-zlib) [ 4387.963982] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 4388.306134] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 4389.975737] Key type lgssc registered [ 4391.555761] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4405.965397] Lustre: DEBUG MARKER: == conf-sanity test 100: check lshowmount lists MGS, MDT, OST and 0@lo ========================================================== 03:31:52 (1785223912) [ 4421.842700] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 4430.259470] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 4463.147192] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4463.167729] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4464.577572] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 4464.632648] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 4464.706538] Lustre: lustre-MDT0000: new disk, initializing [ 4464.760170] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4464.771395] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 4468.725885] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4479.418116] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4479.594364] Lustre: 166605:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 4479.645672] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 4479.649661] Lustre: Skipped 1 previous similar message [ 4479.725529] Lustre: lustre-MDT0001: new disk, initializing [ 4479.863068] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4479.902845] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 4479.914454] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 4484.659234] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4494.199237] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4499.620615] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4505.984546] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4506.318868] Lustre: lustre-OST0000: new disk, initializing [ 4506.324963] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 4506.331566] Lustre: 168571:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 4506.446879] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4511.898965] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4512.317852] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 4512.336196] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 4512.443655] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 4521.196076] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4533.222850] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4533.231324] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 4533.242194] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 4537.688714] Lustre: server umount lustre-OST0000 complete [ 4541.410628] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 4541.416292] LustreError: Skipped 1 previous similar message [ 4541.425594] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4541.435174] Lustre: Skipped 1 previous similar message [ 4541.442982] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4541.448988] Lustre: Skipped 1 previous similar message [ 4543.465225] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4543.477294] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 4543.482606] Lustre: Skipped 1 previous similar message [ 4547.500122] Lustre: server umount lustre-MDT0000 complete [ 4550.583321] LustreError: 166596:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785224058 with bad export cookie 15423299241943058490 [ 4550.595236] LustreError: 166596:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 4550.595543] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 4550.867428] Lustre: server umount lustre-MDT0001 complete [ 4560.850158] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 4563.156715] Key type lgssc unregistered [ 4563.399698] LNet: 170475:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 4563.404636] LNetError: 170475:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 4563.415141] LNet: Removed LNI 192.168.202.131@tcp [ 4564.149096] Key type .llcrypt unregistered [ 4564.151262] Key type ._llcrypt unregistered [ 4587.379906] Key type ._llcrypt registered [ 4587.383102] Key type .llcrypt registered [ 4587.505132] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 4588.489886] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 4588.678635] alg: No test for adler32 (adler32-zlib) [ 4589.714247] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 4589.987819] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 4591.671554] Key type lgssc registered [ 4592.816122] Lustre: Echo OBD driver; http://www.lustre.org/ [ 4600.044995] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 4600.071162] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4601.493901] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 4605.215996] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4611.907968] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 4612.067379] Lustre: lustre-MDT0001: Not available for connect from 0@lo (not set up) [ 4612.162277] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 4616.111288] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4622.683415] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 4627.079842] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 4632.838614] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 4633.130959] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 4638.745544] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 4645.295716] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 4646.439402] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 4651.733627] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4651.758098] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4651.778761] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4651.784462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4651.792648] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4652.659935] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4652.691928] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4652.709941] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4652.728687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4652.740174] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4653.802680] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4653.817207] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4653.826842] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4653.832143] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4653.840916] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4654.516754] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4655.455414] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4656.416592] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4656.423066] Lustre: Skipped 2 previous similar messages [ 4656.435289] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4656.453399] Lustre: Skipped 2 previous similar messages [ 4656.463437] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4656.469936] Lustre: Skipped 2 previous similar messages [ 4656.477302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4656.492468] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4656.512238] Lustre: Skipped 2 previous similar messages [ 4657.348487] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4658.018552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4658.912764] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4659.850801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4660.889556] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4660.893175] Lustre: Skipped 4 previous similar messages [ 4660.907717] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4660.916886] Lustre: Skipped 4 previous similar messages [ 4660.920627] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4660.925486] Lustre: Skipped 4 previous similar messages [ 4660.931320] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4660.938884] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4660.946974] Lustre: Skipped 4 previous similar messages [ 4661.838880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4662.680250] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4663.607206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4664.530457] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4665.493610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4666.522669] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4667.206755] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4668.111037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4668.810990] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4669.581866] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4669.585565] Lustre: Skipped 9 previous similar messages [ 4669.611361] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4669.619323] Lustre: Skipped 9 previous similar messages [ 4669.622755] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4669.633949] Lustre: Skipped 9 previous similar messages [ 4669.637849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4669.651365] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4669.660965] Lustre: Skipped 9 previous similar messages [ 4670.476406] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4671.312652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4672.019812] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4672.801747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4673.625909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4674.407188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4675.292253] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4675.980899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4676.911802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4677.715152] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4678.486858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4679.264496] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4679.899137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4680.710859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4681.441827] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4682.261071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4682.950815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4683.892723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4684.675547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4685.595597] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4685.600935] Lustre: Skipped 19 previous similar messages [ 4685.615892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4686.533264] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4686.540915] Lustre: Skipped 20 previous similar messages [ 4686.555983] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4686.563959] Lustre: Skipped 20 previous similar messages [ 4686.574794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4686.599639] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4686.607995] Lustre: Skipped 20 previous similar messages [ 4687.490652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4688.330610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4689.077419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4689.693279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4690.586584] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4691.364467] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4692.212367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4692.961362] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4693.756928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4694.451908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4695.290057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4696.086314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4696.873905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4697.677558] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4698.536171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4699.176926] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4699.980633] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4700.737697] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4701.656604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4702.303977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4703.132484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4703.836869] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4704.620776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4705.356694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4706.105727] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4706.924322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4707.663935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4708.433640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4709.300586] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4710.030518] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4710.920094] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4711.801757] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4712.609417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4713.389717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4714.090245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4714.885747] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4715.624875] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4716.403610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4717.156042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4718.094240] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4718.098308] Lustre: Skipped 40 previous similar messages [ 4718.112881] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4718.959434] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4718.963657] Lustre: Skipped 40 previous similar messages [ 4718.965778] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4718.967950] Lustre: Skipped 40 previous similar messages [ 4718.969964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4718.975172] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4718.978681] Lustre: Skipped 40 previous similar messages [ 4719.854632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4720.674743] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4721.555295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4722.225242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4722.911242] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4723.630612] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4724.342350] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4725.105682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4725.759212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4726.521190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4727.146511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4727.934984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4728.750279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4729.440547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4730.081683] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4730.870819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4731.686286] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4732.487717] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4733.113883] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4733.860970] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4734.510318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4735.280497] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4736.036088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4736.692501] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4737.370314] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4738.170066] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4738.982351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4739.821836] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4740.599687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4741.587230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4742.327093] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4743.133922] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4743.801563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4744.546795] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4745.196825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4746.151031] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4746.792545] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4747.357410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4748.002378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4748.709279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4749.485226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4750.159855] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4750.779175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4751.645459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4752.333137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4753.112685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4753.920318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4754.748182] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4755.474353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4756.160772] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4756.902432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4757.784565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4758.501509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4759.307800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4760.140980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4760.915425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4761.638509] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4762.418191] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4763.099988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4763.879138] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4764.790887] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4765.561249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4766.260287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4767.076590] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4767.762263] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4768.450691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4769.159279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4770.018488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4770.785502] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4771.563734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4772.332564] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4773.118360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4773.726176] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4774.472930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4775.131758] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4775.809972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4776.503420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4777.273220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4777.982360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4778.657752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4779.217604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4779.874611] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4780.510228] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4781.103022] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4781.752829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4782.402770] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4782.407242] Lustre: Skipped 86 previous similar messages [ 4782.417396] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4783.020508] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4783.025808] Lustre: Skipped 86 previous similar messages [ 4783.027784] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4783.030177] Lustre: Skipped 86 previous similar messages [ 4783.031818] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4783.037327] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4783.039898] Lustre: Skipped 86 previous similar messages [ 4783.665441] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4784.358607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4784.967681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4785.671416] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4786.354718] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4787.027984] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4787.816906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4788.452716] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4789.226370] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4789.942491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4790.665568] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4791.557299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4792.378479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4793.172464] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4793.878603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4794.525178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4795.262928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4795.964555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4796.733129] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4797.371532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4798.047480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4798.790948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4799.432387] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4800.117339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4800.733262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4801.478503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4802.178510] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4802.882164] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4803.525791] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4804.253477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4804.833704] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4805.587534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4806.266931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4807.042353] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4807.724616] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4808.545877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4809.223512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4809.963167] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4810.790479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4811.512809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4812.395450] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4813.373721] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4814.144766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4814.969282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4815.738410] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4816.456969] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4817.299860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4818.205824] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4818.984886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4819.798078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4820.792442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4821.628311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4822.231238] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4823.069846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4823.834512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4824.721588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4825.372384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4826.137823] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4826.896460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4827.708440] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4828.534596] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4829.357316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4830.164266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4831.151560] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.041992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4832.876801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4833.741839] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4834.468446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4835.296941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4836.178714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4837.067946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4837.793574] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4838.512154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4839.225058] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4839.946594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4840.570171] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4841.486218] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4842.234960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4842.953809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4843.494165] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4844.332364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4845.112964] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4845.900681] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4846.793339] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4847.593505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4848.214401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4849.231505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4850.020407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4850.720130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4851.426691] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4852.280409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4852.964517] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4853.789291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4854.538920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4855.261245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4856.046408] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4856.895563] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4857.728379] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4858.508483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4859.472183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4860.491979] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4861.396603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4862.292849] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4863.006592] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4863.906130] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4864.821389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4865.564598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4866.267493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4866.869858] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4867.574646] LustreError: 171911:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -5 [ 4867.581764] LustreError: 171911:0:(osp_precreate.c:1359:osp_precreate_thread()) lustre-OST0000-osc-MDT0000: cannot precreate objects: rc = -5 [ 4867.585600] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4868.295931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4869.022322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4869.763607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4870.451646] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4871.124621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4871.863356] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4872.605161] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4873.366352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4874.097463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4874.786409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4875.479101] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4876.244458] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4876.889768] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4877.687640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4878.359154] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4879.029738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4879.763911] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4880.666846] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4881.375975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4882.213680] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4882.917679] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4883.628289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4884.135289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4884.827907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4885.621625] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4886.405310] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4886.933311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4887.643960] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4888.440057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4889.181870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4889.844117] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4890.512835] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4891.227886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4891.968209] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4892.596825] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4893.262480] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4893.926702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4894.602498] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4895.231027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4895.914401] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4896.546575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4897.385643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4898.003034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4898.711061] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4899.453598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4900.264831] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4900.984499] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4901.837575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4902.601565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4903.302156] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4904.235269] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4905.033469] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4905.798877] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4906.538923] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4907.157385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4907.856247] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4908.559546] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4909.388539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4910.169593] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4910.893968] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 4910.896552] Lustre: Skipped 170 previous similar messages [ 4910.914640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4911.664940] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 4911.673716] Lustre: Skipped 170 previous similar messages [ 4911.679522] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 4911.683579] Lustre: Skipped 170 previous similar messages [ 4911.686832] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4911.691875] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 4911.695769] Lustre: Skipped 170 previous similar messages [ 4912.408565] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4913.008478] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4913.786865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4914.446409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4915.216354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4915.791426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4916.532692] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4917.158566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4917.889405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4918.521605] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4919.238334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4919.901462] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4920.492779] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4921.065880] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4921.768912] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4922.410067] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4923.260341] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4923.966417] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4924.714349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4925.369778] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4926.171896] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4926.803442] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4927.688114] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4928.353283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4928.975272] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4929.604948] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4930.286040] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4930.928924] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4931.796694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4932.820252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4933.995027] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4934.955878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4935.926373] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4936.713862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4937.583582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4938.264930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4939.032539] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4939.677737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4940.329078] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4940.933655] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4941.689157] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4942.329389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4942.918624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4943.561374] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4944.265861] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4944.813198] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4945.438268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4946.082581] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4946.780603] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4947.501908] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4948.235821] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4949.115301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4949.916792] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4950.715069] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4951.551860] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4952.187802] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4952.986124] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4953.607249] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4954.394722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4955.079369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4955.762699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4956.490950] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4957.292057] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4958.031899] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4958.692624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4959.357254] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4960.076220] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4960.818419] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4961.621567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4962.310168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4963.000511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4963.609307] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4964.263221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4964.965316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4965.666459] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4966.328973] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4966.989988] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4967.736980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4968.427702] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4969.182422] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4969.808561] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4970.501808] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4971.109866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4971.757409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4972.315666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4972.935653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4973.579966] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4974.278378] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4975.099105] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4975.913075] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4976.641649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4977.405677] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4978.207366] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4978.772629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4979.421800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4980.082626] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4980.736351] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4981.391072] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4981.972194] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4982.568530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4983.200785] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4983.886624] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4984.509905] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4985.252437] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4985.859322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4986.505418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4987.151139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4987.862024] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4988.427848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4989.126248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4989.809185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4990.534309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4991.250352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4991.906224] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4992.529752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4993.146494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4993.766405] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4994.359956] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4995.089867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4995.836180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4996.498452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4997.093430] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4997.875155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4998.457438] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4999.091569] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 4999.790168] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5000.404777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5001.122859] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5001.753431] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5002.443536] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5003.031359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5003.660303] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5004.227127] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5004.752232] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5005.230484] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5005.905749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5006.454306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5007.143865] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5007.700780] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5008.278137] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5008.848848] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5009.515427] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5010.021777] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5010.644333] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5011.202752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5011.794693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5012.406814] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5012.993993] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5013.483342] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5014.147460] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5014.744868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5015.349549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5015.986759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5016.567645] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5017.192208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5017.847299] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5018.458522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5019.142201] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5019.864241] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5020.440776] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5021.142021] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5021.809759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5022.473354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5023.084978] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5023.721212] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5024.400552] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5025.020627] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5025.542298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5026.101289] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5026.718699] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5027.326866] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5027.910163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5028.439589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5029.002364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5029.487786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5029.936190] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5030.478055] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5030.949547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5031.466547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5032.011576] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5032.545752] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5033.213415] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5033.717335] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5034.250987] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5034.739489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5035.325693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5035.925295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5036.462609] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5037.105208] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5037.755172] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5038.355954] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5038.958604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5039.607864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5040.295864] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5040.924236] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5041.510526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5042.105800] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5042.663455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5043.238635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5043.840837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5044.381488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5045.017508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5045.606870] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5046.265766] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5046.886799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5047.565255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5048.197567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5048.916555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5049.620175] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5050.394195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5051.153940] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5051.926575] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5052.625512] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5053.154974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5053.773315] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5054.387939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5054.902221] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5055.474301] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5056.135298] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5056.753196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5057.451472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5057.998885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5058.626080] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5059.166452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5059.799179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5060.439901] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5061.181336] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5061.780652] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5062.415938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5063.121226] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5063.745360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5064.276582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5064.849491] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5065.462404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5066.122957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5066.801553] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5067.587418] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5068.214833] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5068.893635] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5069.520372] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5070.363426] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5071.082996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5071.909907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5072.734404] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5073.663977] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5074.378217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5075.109503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5075.767210] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5076.553368] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5077.168381] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5077.960139] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5078.659647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5079.301174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5079.932322] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5080.741653] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5081.454845] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5082.204975] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5082.915360] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5083.525369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5084.158444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5084.826941] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5085.339207] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5086.024230] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5086.680957] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5087.396647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5088.090295] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5088.826647] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5089.483838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5090.126723] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5090.832931] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5091.476731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5092.228047] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5092.871607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5093.408784] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5094.140938] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5094.799689] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5095.442428] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5096.176594] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5096.777126] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5097.465090] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5098.190639] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5098.852049] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5099.503262] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5100.112420] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5100.754110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5101.621888] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5102.340885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5102.988383] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5103.565160] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5104.193017] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5104.850251] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5105.565753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5106.332321] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5107.091734] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5107.803274] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5108.495826] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5109.176567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5109.814649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5110.415710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5111.161279] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5111.829455] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5112.618968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5113.328654] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5114.078606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5114.684188] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5115.402907] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5116.140934] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5116.927927] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5117.621492] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5118.369980] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5119.092555] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5119.770543] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5120.494199] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5121.102240] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5121.676732] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5122.294174] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5122.988897] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5123.805598] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5124.468243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5125.178311] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5125.813451] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5126.370649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5127.217989] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5127.889678] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5128.703731] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5129.476537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5130.176032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5130.966606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5131.736343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5132.390666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5133.304958] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5134.001205] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5134.703375] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5135.291972] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5135.959245] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5136.762195] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5137.456358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5138.133151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5138.860076] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5139.552710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5140.176448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5140.964867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5141.610556] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5142.351737] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5143.169077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5143.917589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5144.589490] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5145.319868] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5145.980411] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5146.831526] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5147.444287] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.200325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5148.849044] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5149.571276] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5150.255215] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5150.875892] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5151.552878] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5152.263886] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5152.910180] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5153.733077] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5154.387530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5155.093493] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5155.740708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5156.406513] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5157.022407] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5157.818252] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5158.556566] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5159.231829] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5159.846384] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5160.511570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5161.226756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5161.926816] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5162.632316] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5163.300853] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5164.105847] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5165.032809] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5165.768503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5166.502446] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5167.091877] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 5167.096371] Lustre: Skipped 379 previous similar messages [ 5167.117638] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5167.891941] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 5167.900496] Lustre: Skipped 379 previous similar messages [ 5167.907572] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 5167.911336] Lustre: Skipped 379 previous similar messages [ 5167.915751] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5167.924197] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 5167.929890] Lustre: Skipped 379 previous similar messages [ 5168.539867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5169.291309] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5169.939629] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5170.645662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5171.297470] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5172.085582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5172.941744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5173.686223] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5174.357354] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5175.142902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5175.870358] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5176.546436] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5177.217110] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5177.909707] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5178.507903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5179.195532] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5179.872522] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5180.603385] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5181.251505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5181.948367] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5182.490549] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5183.226476] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5183.818155] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.411834] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5184.969935] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5185.515951] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5186.083974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5186.617983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5187.232331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5187.837332] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5188.460217] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5189.103255] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5189.767840] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5190.460444] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5191.140933] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5191.897268] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5192.494838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5193.176534] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5193.878946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5194.707248] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5195.488266] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5196.273657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5197.020687] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5197.669708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5198.330261] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5199.044369] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5199.569273] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5200.307759] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5201.116179] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5201.779463] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5202.435963] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5203.124508] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5203.779292] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5204.515183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5205.180602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5206.011606] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5206.637955] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5207.303666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5208.060983] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5208.843610] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5209.456895] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5210.155744] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5210.875541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5211.614909] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5212.258844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5212.996885] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5213.707243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5214.461930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5215.081030] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5215.702122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5216.268739] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5216.850946] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5217.471302] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5218.088503] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5218.661344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5219.355202] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5220.099662] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5220.849389] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5221.540489] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5222.282761] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5222.984862] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5223.761578] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5224.643280] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5225.441409] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5226.206359] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5226.848657] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5227.492682] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5228.172429] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5228.925968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5229.702540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5230.360587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5231.069582] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5231.727488] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5232.433738] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5233.175588] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5233.806838] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5234.478092] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5235.147343] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5235.768032] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5236.473452] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5237.065967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5237.869753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5238.604494] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5239.203589] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5239.978530] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5240.654932] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5241.355952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5242.004587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5242.743837] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5243.471486] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5244.304630] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5245.072965] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5246.027511] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5246.754604] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5247.598084] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5248.313147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5249.077968] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5249.829283] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5250.649185] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5251.414071] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5252.298326] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5253.128642] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5253.994705] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5254.856608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5255.788034] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5256.528952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5257.379119] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5258.054479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5258.869504] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5259.524724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5260.271234] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5260.998364] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5261.745477] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5262.485628] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5263.248244] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5264.098871] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5265.014231] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5265.804377] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5266.749753] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5267.547733] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5268.337918] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5269.025587] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5269.952928] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5270.819585] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5271.636783] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5272.348070] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5273.152991] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5273.861122] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5274.727550] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5275.517643] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5276.360424] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5277.170479] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5277.933748] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5278.655906] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5279.439621] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5280.101685] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5280.771163] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5281.430601] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5282.264537] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5282.951514] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5283.550483] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5284.282765] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5285.111184] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5285.773042] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5286.502867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5287.222637] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5287.866271] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5288.485724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5289.232141] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5289.949786] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5290.751693] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5291.518607] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5292.271974] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5293.015472] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5293.868798] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5294.577308] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5295.462296] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5296.100317] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5296.814736] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5297.557688] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5298.278334] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5299.069602] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5299.904722] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5300.610939] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5301.352275] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5302.056425] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5302.838749] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5303.723445] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5304.634246] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5305.456745] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5306.457815] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5307.507330] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5308.510481] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5309.462844] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5310.357640] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5311.168524] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5311.983037] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5312.793841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5313.573046] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5314.464967] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5315.356746] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5316.118910] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5316.885170] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5317.617088] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5318.481694] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5319.194474] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5320.095206] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5321.016547] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5321.820872] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5322.649996] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5323.440930] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5324.206794] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5325.040331] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5325.876413] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5326.793448] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5327.626453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5328.501649] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5329.355306] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5330.260756] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5331.143714] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5331.991608] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5332.786540] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5333.678196] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5334.445053] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5335.292665] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5336.223376] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5337.032277] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5337.841902] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5338.758349] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5339.537903] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5340.490433] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5341.196278] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5342.170632] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5342.947799] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5344.019434] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5344.745325] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5345.529882] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5346.422801] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5347.261082] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5348.233952] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5349.105841] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5349.894567] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5350.773595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5351.560056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5352.383243] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5353.334666] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5354.048282] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5354.868676] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5355.889291] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5356.664505] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5357.663595] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5358.612318] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5359.507981] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5360.254920] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5360.933879] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5361.601035] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5362.403570] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5363.175541] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5364.010720] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5364.848819] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5365.671453] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5366.376992] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5367.116867] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5367.824613] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5368.577767] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5369.284724] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5370.088183] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5370.795708] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5371.554323] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5372.175344] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5372.837432] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5373.478919] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5374.127089] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5374.741506] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5375.460147] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5376.202239] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5376.871178] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5377.607710] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5378.353151] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 5805.769421] LustreError: 174381:0:(ofd_dev.c:1780:ofd_create_hdl()) lustre-OST0000: unable to precreate: rc = -28 [ 5805.772858] LustreError: 171911:0:(osp_precreate.c:655:osp_precreate_send()) lustre-OST0000-osc-MDT0000: can't precreate: rc = -28 [ 6277.088535] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 6277.095162] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6277.105596] Lustre: Skipped 279 previous similar messages [ 6277.128398] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6278.632898] LustreError: 225909:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6278.664181] LustreError: 225909:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 6279.024873] Lustre: server umount lustre-OST0000 complete [ 6286.320087] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6286.333080] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6288.865868] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6288.868647] Lustre: Skipped 1 previous similar message [ 6291.080867] Lustre: server umount lustre-MDT0000 complete [ 6293.985377] LustreError: 172937:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6294.018417] LustreError: 172937:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6295.050560] LustreError: 218458:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785225802 with bad export cookie 2222092537243670728 [ 6295.052983] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6295.058884] LustreError: 218458:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6295.581078] Lustre: server umount lustre-MDT0001 complete [ 6310.173241] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 6312.281728] Key type lgssc unregistered [ 6312.678253] LNet: 227095:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6312.684521] LNetError: 227095:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6312.699614] LNet: Removed LNI 192.168.202.131@tcp [ 6313.676557] Key type .llcrypt unregistered [ 6313.679377] Key type ._llcrypt unregistered [ 6339.644854] Key type ._llcrypt registered [ 6339.647129] Key type .llcrypt registered [ 6339.757923] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 6340.710398] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6340.824113] alg: No test for adler32 (adler32-zlib) [ 6342.085413] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 6342.418229] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 6344.151247] Key type lgssc registered [ 6346.222409] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6355.686283] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6355.738643] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6357.350475] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6361.548720] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6367.714976] LustreError: 228511:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6367.733351] LustreError: 228511:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 6370.942974] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6371.268509] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6376.216463] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6384.043774] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 6390.650757] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 6398.400796] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6398.730725] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6402.880046] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49665 to 0x280000401:49696) [ 6406.009951] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6414.524626] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6422.359943] Lustre: setting import lustre-OST0000_UUID INACTIVE by administrator request [ 6424.282486] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6424.296479] Lustre: lustre-OST0000: Client lustre-MDT0000-mdtlov_UUID (at 0@lo) reconnecting [ 6424.306056] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6424.322746] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6424.328231] LustreError: 228531:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 sleeping for 20000ms [ 6426.552250] Lustre: lustre-OST0000: Not available for connect from 192.168.202.31@tcp (stopping) [ 6426.594844] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6426.595851] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6426.624262] Lustre: Skipped 1 previous similar message [ 6431.595115] Lustre: lustre-OST0000: Not available for connect from 192.168.202.31@tcp (stopping) [ 6431.607033] Lustre: Skipped 2 previous similar messages [ 6432.504952] Lustre: server umount lustre-OST0000 complete [ 6444.415135] LustreError: 228531:0:(osp_precreate.c:1268:osp_precreate_thread()) cfs_fail_timeout id 2107 awake [ 6466.317069] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6466.623832] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6473.759688] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6480.456150] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 6481.963352] LustreError: lustre-OST0000-osc-MDT0000: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6481.979339] LustreError: lustre-OST0000-osc-MDT0001: This client was evicted by lustre-OST0000; in progress operations using this service will fail. [ 6481.985042] Lustre: lustre-OST0000-osc-MDT0000: Connection restored to 0@lo (at 0@lo) [ 6482.008542] Lustre: Skipped 1 previous similar message [ 6484.143422] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 2 sec [ 6489.376570] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9a4d0323a800.ost_server_uuid 50 [ 6490.770978] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9a4d0323a800.ost_server_uuid in FULL state after 0 sec [ 6497.249651] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 6497.255056] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6497.255822] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 6497.255826] Lustre: Skipped 2 previous similar messages [ 6497.302197] Lustre: Skipped 1 previous similar message [ 6500.917505] Lustre: server umount lustre-OST0000 complete [ 6507.503447] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6507.513157] Lustre: Skipped 1 previous similar message [ 6507.513507] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6507.521577] Lustre: Skipped 1 previous similar message [ 6512.613683] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6512.617550] Lustre: Skipped 2 previous similar messages [ 6519.263150] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 6519.434854] Lustre: server umount lustre-MDT0000 complete [ 6522.847989] LustreError: 228511:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6522.865759] LustreError: 228511:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 6522.977505] LustreError: 228492:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785226030 with bad export cookie 17336073893150608424 [ 6522.986840] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6522.991888] LustreError: 228492:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6523.529792] Lustre: server umount lustre-MDT0001 complete [ 6535.826392] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 6539.177652] Key type lgssc unregistered [ 6539.597875] LNet: 233721:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 6539.603418] LNetError: 233721:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 6539.614500] LNet: Removed LNI 192.168.202.131@tcp [ 6540.732094] Key type .llcrypt unregistered [ 6540.735758] Key type ._llcrypt unregistered [ 6575.737114] Key type ._llcrypt registered [ 6575.738237] Key type .llcrypt registered [ 6575.796527] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 6577.216934] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 6577.253531] alg: No test for adler32 (adler32-zlib) [ 6578.221725] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 6578.440868] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 6580.087169] Key type lgssc registered [ 6581.704600] Lustre: Echo OBD driver; http://www.lustre.org/ [ 6590.682264] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 6590.700667] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6592.219031] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6597.093129] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6602.752893] LustreError: 235450:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6602.788064] LustreError: 235450:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 6605.250598] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6605.499790] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6609.532405] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6612.480875] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [ 6619.209418] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6619.579983] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6626.253780] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6634.864131] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6635.086463] Lustre: lustre-OST0001: new disk, initializing [ 6635.090529] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 6635.098515] Lustre: 237759:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 6635.205847] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [ 6636.110353] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 6636.135477] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 6636.301966] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 6637.286740] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49698 to 0x280000401:49728) [ 6641.710485] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6652.602651] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6660.917580] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [ 6677.473743] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 6677.477918] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6677.502658] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6678.502601] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6678.518827] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6678.525102] Lustre: Skipped 2 previous similar messages [ 6678.546699] Lustre: Skipped 3 previous similar messages [ 6680.048423] Lustre: server umount lustre-MDT0000 complete [ 6683.621761] LustreError: 236961:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6683.653572] LustreError: 236961:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 6684.754579] LustreError: 235432:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785226192 with bad export cookie 1821381170846093192 [ 6684.762494] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6684.770563] LustreError: 235432:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 6685.489579] Lustre: server umount lustre-MDT0001 complete [ 6700.744907] Lustre: server umount lustre-OST0000 complete [ 6705.099599] Lustre: 234711:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785226196/real 1785226196] req@ffff9e175864c000 x1871945228449152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785226212 ref 1 fl Rpc:EXNQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 6714.675477] Lustre: server umount lustre-OST0001 complete [ 6737.724734] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 6747.845557] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6748.267115] LustreError: 240874:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6748.349535] Lustre: mylustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6753.297822] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6753.774432] LustreError: 240875:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6758.895885] LustreError: 240874:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6762.950495] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6763.547604] Lustre: mylustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 6768.621931] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6771.810804] Lustre: 242015:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6779.321679] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6779.734217] Lustre: mylustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 6786.522344] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6788.985848] LustreError: 242367:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6794.109570] Lustre: mylustre-OST0000: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49730 to 0x280000401:49760) [ 6796.565583] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6802.432237] Lustre: mylustre-OST0001: new connection from mylustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [ 6804.296100] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6811.977591] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6815.409800] Lustre: 243886:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 6828.003384] Lustre: mylustre-MDT0000-lwp-OST0001: Connection to mylustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6828.008574] Lustre: mylustre-MDT0000: Not available for connect from 0@lo (stopping) [ 6828.022352] Lustre: Skipped 2 previous similar messages [ 6828.046055] Lustre: Skipped 3 previous similar messages [ 6832.667893] Lustre: server umount mylustre-MDT0000 complete [ 6833.124873] LustreError: 240874:0:(ldlm_lib.c:1192:target_handle_connect()) mylustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6833.137616] LustreError: 240874:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 6836.564856] LustreError: 243888:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785226344 with bad export cookie 1821381170846095992 [ 6836.566041] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6836.579872] LustreError: 243888:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6837.012682] Lustre: server umount mylustre-MDT0001 complete [ 6851.985577] Lustre: server umount mylustre-OST0000 complete [ 6855.136879] Lustre: 234712:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785226346/real 1785226346] req@ffff9e175d168700 x1871945228509440/t0(0) o400->mylustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785226362 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [ 6855.176879] Lustre: mylustre-MDT0001-lwp-OST0001: Connection to mylustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6855.196844] Lustre: Skipped 1 previous similar message [ 6856.421214] Lustre: server umount mylustre-OST0001 complete [ 6879.391380] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 6891.179124] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6891.550041] LustreError: 246194:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6891.569367] LustreError: 246194:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 6891.632672] Lustre: tfs-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 6891.636030] Lustre: Skipped 1 previous similar message [ 6895.939758] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6906.672896] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 6912.732185] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6916.866898] Lustre: 247336:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 6924.219240] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6930.598279] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6936.904804] Lustre: tfs-OST0000: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49762 to 0x280000401:49792) [ 6939.363032] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 6944.750152] Lustre: tfs-OST0001: new connection from tfs-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [ 6946.345292] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 6953.776275] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 6957.434342] Lustre: 249206:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 6965.228835] Lustre: tfs-MDT0000-lwp-OST0001: Connection to tfs-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 6965.254670] Lustre: tfs-MDT0000: Not available for connect from 0@lo (stopping) [ 6965.267231] Lustre: Skipped 2 previous similar messages [ 6965.293016] Lustre: Skipped 3 previous similar messages [ 6967.145303] Lustre: server umount tfs-MDT0000 complete [ 6970.342759] LustreError: 246191:0:(ldlm_lib.c:1192:target_handle_connect()) tfs-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 6970.359533] LustreError: 246191:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 9 previous similar messages [ 6970.889830] LustreError: 246169:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785226478 with bad export cookie 1821381170846097882 [ 6970.893416] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 6970.903867] LustreError: 246169:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 6971.192651] Lustre: server umount tfs-MDT0001 complete [ 6986.028730] Lustre: server umount tfs-OST0000 complete [ 6999.370500] Lustre: server umount tfs-OST0001 complete [ 7020.238874] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 7029.696301] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7030.232545] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7030.237256] Lustre: Skipped 3 previous similar messages [ 7034.834782] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7043.622388] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7048.830356] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7052.298415] Lustre: 252598:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [ 7059.540961] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7066.840792] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7075.833831] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:49762 to 0x280000401:49824) [ 7076.484574] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7081.980927] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [ 7082.931839] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7090.660444] Lustre: DEBUG MARKER: Using TIMEOUT=20 [ 7094.637070] Lustre: 254468:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [ 7101.613605] Lustre: DEBUG MARKER: == conf-sanity test 104a: Make sure user defined options are reflected in mount ========================================================== 04:16:48 (1785226608) [ 7117.803074] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7117.812722] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7117.814804] Lustre: Skipped 3 previous similar messages [ 7117.838497] Lustre: Skipped 3 previous similar messages [ 7128.039492] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7128.042103] Lustre: Skipped 4 previous similar messages [ 7132.127153] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7132.358638] Lustre: server umount lustre-MDT0000 complete [ 7133.158452] LustreError: 252189:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7133.172295] LustreError: 252189:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 10 previous similar messages [ 7135.924529] LustreError: 251431:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785226643 with bad export cookie 1821381170846099548 [ 7135.938520] LustreError: 251431:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [ 7135.942264] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7138.283356] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7138.292431] Lustre: Skipped 2 previous similar messages [ 7142.403280] Lustre: server umount lustre-MDT0001 complete [ 7153.374045] Lustre: server umount lustre-OST0000 complete [ 7162.902502] Lustre: server umount lustre-OST0001 complete [ 7171.106496] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 7183.728639] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 7225.040180] LDISKFS-fs (dm-0): Mount option "noacl" will be removed by 3.5 [ 7225.040180] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7225.040180] [ 7225.101087] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7225.407821] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7225.464133] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7225.564858] Lustre: lustre-MDT0000: new disk, initializing [ 7225.652809] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7225.657609] Lustre: Skipped 3 previous similar messages [ 7225.669528] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7231.443944] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7242.281382] LDISKFS-fs (dm-1): Mount option "noacl" will be removed by 3.5 [ 7242.281382] Contact linux-ldiskfs@vger.kernel.org if you think we should keep it. [ 7242.281382] [ 7242.314125] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: acl,user_xattr,errors=remount-ro,noacl,no_mbcache,nodelalloc [ 7242.443480] Lustre: 257651:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7242.498826] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7242.502516] Lustre: Skipped 1 previous similar message [ 7242.562333] Lustre: lustre-MDT0001: new disk, initializing [ 7242.659273] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7242.670701] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7248.025097] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7260.691472] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7261.098711] Lustre: lustre-OST0000: new disk, initializing [ 7261.110353] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 7261.121645] Lustre: 259236:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7262.980891] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 7262.988335] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7263.128653] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7267.200490] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7277.181214] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7277.346354] Lustre: lustre-OST0001: new disk, initializing [ 7277.349144] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [ 7277.353885] Lustre: 260108:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7278.594399] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [ 7278.607192] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [ 7278.710504] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [ 7284.340946] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7297.323515] Lustre: DEBUG MARKER: == conf-sanity test 104b: Mount uses last flock argument ========================================================== 04:20:03 (1785226803) [ 7312.405222] Lustre: DEBUG MARKER: == conf-sanity test 105: check file creation for ro and rw bind mnt pt ========================================================== 04:20:18 (1785226818) [ 7329.770196] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7329.774678] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7329.779299] LustreError: Skipped 1 previous similar message [ 7329.781755] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7329.794325] Lustre: Skipped 1 previous similar message [ 7329.814057] Lustre: Skipped 8 previous similar messages [ 7334.392427] Lustre: server umount lustre-OST0000 complete [ 7340.005865] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7353.314289] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7353.727179] Lustre: server umount lustre-MDT0000 complete [ 7358.810743] LustreError: 257645:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785226866 with bad export cookie 1821381170846101102 [ 7358.815516] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7358.838238] LustreError: 257645:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7363.488986] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7363.490895] Lustre: Skipped 10 previous similar messages [ 7373.279548] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7373.671891] Lustre: server umount lustre-MDT0001 complete [ 7385.540189] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 7397.754899] Lustre: server umount lustre-OST0001 complete [ 7404.868544] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 7421.129444] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 7463.377556] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7463.619389] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 7463.658233] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 7463.740583] Lustre: lustre-MDT0000: new disk, initializing [ 7463.858632] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 7469.072835] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7480.071534] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7480.242327] Lustre: 264668:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 7480.363125] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 7480.367396] Lustre: Skipped 1 previous similar message [ 7480.502454] Lustre: lustre-MDT0001: new disk, initializing [ 7480.780152] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 7480.795445] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 7485.590807] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7495.708286] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7501.233649] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7508.007848] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7508.275226] Lustre: 266638:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7508.382735] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7508.391491] Lustre: Skipped 5 previous similar messages [ 7509.731661] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 7509.888114] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 7515.482947] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7526.079888] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7535.589409] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7535.597509] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7535.606832] Lustre: Skipped 5 previous similar messages [ 7535.619959] Lustre: Skipped 2 previous similar messages [ 7538.690082] Lustre: server umount lustre-OST0000 complete [ 7548.559529] Lustre: server umount lustre-MDT0000 complete [ 7550.952294] LustreError: 264682:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7550.994173] LustreError: 264682:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 17 previous similar messages [ 7552.175832] LustreError: 264663:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785227060 with bad export cookie 1821381170846102572 [ 7552.192452] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7552.193293] LustreError: 264663:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 7552.502979] Lustre: server umount lustre-MDT0001 complete [ 7563.468715] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 7565.935981] Key type lgssc unregistered [ 7566.165504] LNet: 268399:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7566.187178] LNetError: 268399:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7566.210544] LNet: Removed LNI 192.168.202.131@tcp [ 7567.362476] Key type .llcrypt unregistered [ 7567.369941] Key type ._llcrypt unregistered [ 7597.776258] Key type ._llcrypt registered [ 7597.779602] Key type .llcrypt registered [ 7597.887284] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 7599.782794] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7599.866137] alg: No test for adler32 (adler32-zlib) [ 7600.878783] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 7601.080863] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 7602.719372] Key type lgssc registered [ 7603.703919] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7611.026809] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7611.038834] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7612.497147] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7617.305779] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7622.636799] LustreError: 269862:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7622.652637] LustreError: 269862:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [ 7626.039695] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7626.406658] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7630.878689] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7638.699425] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 7644.742868] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 7651.502879] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7651.800314] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7657.391761] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7657.972344] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:3 to 0x280000401:33) [ 7663.565489] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7664.350364] Lustre: Setting parameter lustre-OST0000.ost.unknown_param=50 in log lustre-OST0000 [ 7668.195297] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 7668.198447] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7668.212520] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7671.264715] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 7672.467501] Lustre: server umount lustre-OST0000 complete [ 7676.384178] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7676.394363] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7676.397197] Lustre: Skipped 1 previous similar message [ 7676.410760] Lustre: Skipped 2 previous similar messages [ 7681.505683] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7681.513744] Lustre: Skipped 1 previous similar message [ 7682.580174] Lustre: server umount lustre-MDT0000 complete [ 7685.884492] LustreError: 270597:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785227193 with bad export cookie 304132443765921888 [ 7685.888976] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7685.894760] LustreError: 270597:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 7686.218264] Lustre: server umount lustre-MDT0001 complete [ 7696.334531] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 7699.371974] Key type lgssc unregistered [ 7699.792391] LNet: 273453:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7699.809532] LNetError: 273453:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7700.837851] LNet: Removed LNI 192.168.202.131@tcp [ 7701.862458] Key type .llcrypt unregistered [ 7701.866484] Key type ._llcrypt unregistered [ 7719.813779] Key type ._llcrypt registered [ 7719.817671] Key type .llcrypt registered [ 7719.979151] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 7721.218962] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7721.301761] alg: No test for adler32 (adler32-zlib) [ 7722.404910] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 7722.663920] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 7724.351183] Key type lgssc registered [ 7725.434813] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7733.665251] Lustre: lustre-OST0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7733.682708] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7749.151367] LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. [ 7754.272519] LustreError: 274646:0:(mgc_request.c:233:do_config_log_add()) MGC192.168.202.131@tcp: failed processing log, type 4: rc = -110 [ 7780.964976] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7786.677805] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 7793.032433] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 7794.672609] Lustre: server umount lustre-OST0000 complete [ 7809.026657] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 7811.870091] Key type lgssc unregistered [ 7812.230628] LNet: 276277:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 7812.249089] LNetError: 276277:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 7812.284324] LNet: Removed LNI 192.168.202.131@tcp [ 7813.203276] Key type .llcrypt unregistered [ 7813.205252] Key type ._llcrypt unregistered [ 7850.709611] Key type ._llcrypt registered [ 7850.712142] Key type .llcrypt registered [ 7850.852951] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 7852.803427] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 7852.846532] alg: No test for adler32 (adler32-zlib) [ 7854.064404] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 7854.416618] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 7856.087216] Key type lgssc registered [ 7857.650327] Lustre: Echo OBD driver; http://www.lustre.org/ [ 7870.502851] loop0: detected capacity change from 0 to 204800000 [ 7870.633284] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7870.643959] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7870.954442] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7872.107444] loop0: detected capacity change from 0 to 204800000 [ 7872.215693] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7872.240277] blk_update_request: operation not supported error, dev loop0, sector 208 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7872.575029] blk_update_request: operation not supported error, dev loop0, sector 160232 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7873.531526] loop0: detected capacity change from 0 to 204800000 [ 7873.738982] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7873.745469] blk_update_request: operation not supported error, dev loop0, sector 8224 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7873.864201] blk_update_request: operation not supported error, dev loop0, sector 58264 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7874.829570] loop0: detected capacity change from 0 to 204800000 [ 7875.045208] blk_update_request: operation not supported error, dev loop0, sector 399872 op 0x9:(WRITE_ZEROES) flags 0x400800 phys_seg 0 prio class 0 [ 7876.150474] loop0: detected capacity change from 0 to 204800000 [ 7876.176209] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7879.825953] loop0: detected capacity change from 0 to 204800000 [ 7879.903383] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7883.670361] loop0: detected capacity change from 0 to 204800000 [ 7883.709331] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7888.168724] loop0: detected capacity change from 0 to 204800000 [ 7888.211890] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: (null) [ 7892.645244] loop0: detected capacity change from 0 to 204800000 [ 7892.766567] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 7892.811732] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7892.914373] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7892.950922] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000-MDT0000' with [0x200000005:0x3:0x0]: rc = 0 [ 7892.966874] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000-MDT0000' with [0x200000005:0x2:0x0]: rc = 0 [ 7892.987296] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000-MDT0000' with [0x200000005:0x1:0x0]: rc = 0 [ 7892.999326] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000003:0xc:0x0]: rc = 0 [ 7893.007448] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000003:0xa:0x0]: rc = 0 [ 7893.029990] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000003:0xb:0x0]: rc = 0 [ 7893.041760] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index 'nodemap' with [0x200000003:0x3:0x0]: rc = 0 [ 7893.049661] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x20000' with [0x200000006:0x20000:0x0]: rc = 0 [ 7893.059628] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1020000' with [0x200000006:0x1020000:0x0]: rc = 0 [ 7893.068352] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2020000' with [0x200000006:0x2020000:0x0]: rc = 0 [ 7893.079900] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x2010000' with [0x200000006:0x2010000:0x0]: rc = 0 [ 7893.088211] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x10000' with [0x200000006:0x10000:0x0]: rc = 0 [ 7893.099906] Lustre: 279687:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0000: restore index '0x1010000' with [0x200000006:0x1010000:0x0]: rc = 0 [ 7898.521557] Lustre: server umount MGS complete [ 7899.333853] loop0: detected capacity change from 0 to 204800000 [ 7899.400366] LDISKFS-fs (loop0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7899.909527] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 7899.971857] Lustre: lustre-MDT0000: Aborting client recovery [ 7900.852195] loop1: detected capacity change from 0 to 204800000 [ 7900.980900] LDISKFS-fs (loop1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 7901.022878] Lustre: 280121:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7901.028363] Lustre: 280121:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000' with [0x200000003:0x4:0x0]: rc = 0 [ 7901.034282] Lustre: 280121:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000' with [0x200000003:0x5:0x0]: rc = 0 [ 7901.040862] Lustre: 280121:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000-MDT0001' with [0x200000005:0x3:0x0]: rc = 0 [ 7901.047934] Lustre: 280121:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x2010000' with [0x200000003:0x6:0x0]: rc = 0 [ 7901.054291] Lustre: 280121:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x10000-MDT0001' with [0x200000005:0x1:0x0]: rc = 0 [ 7901.060592] Lustre: 280121:0:(osd_scrub.c:1854:osd_index_restore()) lustre-MDT0001: restore index '0x1010000-MDT0001' with [0x200000005:0x2:0x0]: rc = 0 [ 7901.074977] Lustre: Found index 1 for lustre-MDT0001, updating log [ 7901.229876] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 7901.280134] Lustre: lustre-MDT0001: Aborting client recovery [ 7902.247393] loop2: detected capacity change from 0 to 204800000 [ 7902.423119] LDISKFS-fs (loop2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7902.507983] Lustre: 280200:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7902.527651] Lustre: 280200:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 7902.543477] Lustre: 280200:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000-OST0000' with [0x200000005:0x2:0x0]: rc = 0 [ 7902.560341] Lustre: 280200:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 7902.570168] Lustre: 280200:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000-OST0000' with [0x200000005:0x1:0x0]: rc = 0 [ 7902.581263] Lustre: 280200:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x2020000-OST0000' with [0x200000005:0x3:0x0]: rc = 0 [ 7902.597167] Lustre: 280200:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0000: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 7902.696574] Lustre: Found index 0 for lustre-OST0000, updating log [ 7902.742810] Lustre: 280219:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7902.823540] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 7902.860608] Lustre: lustre-OST0000: Aborting recovery [ 7903.867342] loop3: detected capacity change from 0 to 204800000 [ 7904.054501] LDISKFS-fs (loop3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 7904.201777] Lustre: 280284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index 'fld' with [0x200000001:0x3:0x0]: rc = 0 [ 7904.215264] Lustre: 280284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000-OST0001' with [0x200000005:0x2:0x0]: rc = 0 [ 7904.237630] Lustre: 280284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000-OST0001' with [0x200000005:0x3:0x0]: rc = 0 [ 7904.261085] Lustre: 280284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000' with [0x200000003:0x5:0x0]: rc = 0 [ 7904.276462] Lustre: 280284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x2020000' with [0x200000003:0x7:0x0]: rc = 0 [ 7904.289748] Lustre: 280284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x20000-OST0001' with [0x200000005:0x1:0x0]: rc = 0 [ 7904.304469] Lustre: 280284:0:(osd_scrub.c:1854:osd_index_restore()) lustre-OST0001: restore index '0x1020000' with [0x200000003:0x6:0x0]: rc = 0 [ 7904.329868] Lustre: Found index 1 for lustre-OST0001, updating log [ 7904.351838] Lustre: 280291:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 7904.436184] Lustre: lustre-OST0001: Aborting recovery [ 7909.539472] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 7909.547436] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x0:6 to 0x0:33) [ 7909.582515] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000bd0 [ 7909.595184] LustreError: 280065:0:(lod_dev.c:511:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000: get update log duration 10, retries 0, failed: rc = -108 [ 7909.617052] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000bd0 [ 7911.596203] Lustre: lustre-OST0000: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x280000400:5 to 0x280000400:33) [ 7911.596965] Lustre: lustre-OST0001: new connection from lustre-MDT0001-mdtlov (cleaning up unused objects from 0x2c0000400:5 to 0x2c0000400:33) [ 7913.488474] LustreError: 280032:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 1679us: rc = -2 [ 7914.046620] LustreError: 280033:0:(mdt_identity.c:115:mdt_identity_do_upcall()) lustre-MDT0000: error invoking upcall /root/Work/Lustre/R5/lustre-release/lustre/tests/../utils/l_getidentity lustre-MDT0000 0: rc -2; check /proc/fs/lustre/mdt/lustre-MDT0000/identity_upcall, time 361us: rc = -2 [ 7914.058316] LustreError: 280033:0:(mdt_identity.c:115:mdt_identity_do_upcall()) Skipped 22 previous similar messages [ 7926.753696] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 7926.759249] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7926.767127] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7927.265725] Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7927.278347] Lustre: Skipped 1 previous similar message [ 7927.282916] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7927.285701] Lustre: Skipped 3 previous similar messages [ 7932.386190] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 7932.394085] Lustre: Skipped 3 previous similar messages [ 7933.125341] Lustre: server umount lustre-MDT0000 complete [ 7933.889523] LustreError: 280014:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785227441 with bad export cookie 10907296644784530587 [ 7933.899024] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 7937.504097] LustreError: 280029:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7937.506854] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 7937.514670] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7937.525340] LustreError: 280029:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 7937.564836] Lustre: Skipped 2 previous similar messages [ 7938.531447] LustreError: 280030:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7938.558373] LustreError: 280030:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7943.648933] LustreError: 280031:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 7943.649072] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [ 7943.673845] LustreError: 280031:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 7943.685935] Lustre: Skipped 4 previous similar messages [ 7948.255778] Lustre: lustre-MDT0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7948.599433] Lustre: server umount lustre-MDT0001 complete [ 7955.906214] Lustre: server umount lustre-OST0000 complete [ 7971.295169] Lustre: lustre-OST0001 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [ 7971.992706] Lustre: server umount lustre-OST0001 complete [ 7981.674830] Lustre: DEBUG MARKER: == conf-sanity test 109a: test lctl clear_conf fsname ==== 04:31:28 (1785227488) [ 8013.923492] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 8026.291767] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 8068.418360] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8068.783612] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8068.818532] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8068.888574] Lustre: lustre-MDT0000: new disk, initializing [ 8068.956499] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8068.963461] Lustre: Skipped 1 previous similar message [ 8068.979468] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8075.032445] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8087.816825] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8087.874539] Lustre: 284365:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8087.900360] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8087.901985] Lustre: Skipped 1 previous similar message [ 8087.952237] Lustre: lustre-MDT0001: new disk, initializing [ 8088.023533] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8088.053238] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8088.058745] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8092.174746] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8101.503628] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8107.339475] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8114.939786] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8115.238980] Lustre: lustre-OST0000: new disk, initializing [ 8115.242781] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8115.252898] Lustre: 286334:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8115.382230] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8121.943284] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8121.966940] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8122.211236] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8124.618168] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8135.888800] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8141.061152] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8151.360768] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8159.768443] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8168.886821] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8224.749449] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8224.756581] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8224.794050] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8224.804531] Lustre: Skipped 1 previous similar message [ 8225.872288] Lustre: server umount lustre-OST0000 complete [ 8229.858112] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8229.864045] Lustre: Skipped 1 previous similar message [ 8236.038800] Lustre: server umount lustre-MDT0000 complete [ 8240.098874] LustreError: 284377:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8240.123750] LustreError: 284377:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 8240.204849] LustreError: 287533:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785227748 with bad export cookie 10907296644784533296 [ 8240.214970] LustreError: 287533:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8240.228163] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8240.684693] Lustre: server umount lustre-MDT0001 complete [ 8249.657978] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8254.322294] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8259.450794] Lustre: server umount MGS complete [ 8271.134697] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8271.760743] LustreError: 290210:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8271.795708] LustreError: 290223:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8271.849551] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8276.201252] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8282.083072] LustreError: 290211:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8282.106332] LustreError: 290211:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 8284.932170] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8290.124870] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8297.611611] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8305.285948] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8315.468926] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8315.925566] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8315.929454] Lustre: Skipped 1 previous similar message [ 8322.794245] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8331.805736] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8362.978187] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 8362.986021] LustreError: Skipped 1 previous similar message [ 8362.987832] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8363.009516] Lustre: Skipped 1 previous similar message [ 8363.017187] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8363.022593] Lustre: Skipped 4 previous similar messages [ 8366.058962] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8368.785867] Lustre: server umount lustre-OST0000 complete [ 8379.536883] Lustre: server umount lustre-MDT0000 complete [ 8381.414551] LustreError: 291457:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8381.429702] LustreError: 291457:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [ 8384.209924] LustreError: 290190:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785227892 with bad export cookie 10907296644784535249 [ 8384.213609] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8384.221116] LustreError: 290190:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 5 previous similar messages [ 8384.652381] Lustre: server umount lustre-MDT0001 complete [ 8396.829467] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 8400.596544] Key type lgssc unregistered [ 8400.914237] LNet: 294160:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8400.925691] LNetError: 294160:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8401.972673] LNet: Removed LNI 192.168.202.131@tcp [ 8402.921332] Key type .llcrypt unregistered [ 8402.926925] Key type ._llcrypt unregistered [ 8444.960400] Key type ._llcrypt registered [ 8444.963569] Key type .llcrypt registered [ 8445.145480] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 8464.192534] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 8465.294900] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8465.333382] alg: No test for adler32 (adler32-zlib) [ 8466.681843] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 8467.013671] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 8468.719299] Key type lgssc registered [ 8469.894816] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8515.746189] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8515.781781] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8517.188629] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8517.255780] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8517.463776] Lustre: lustre-MDT0000: new disk, initializing [ 8517.539943] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8517.552549] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8522.760149] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8534.767250] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8534.885816] Lustre: 298123:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 8534.938792] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 8534.942192] Lustre: Skipped 1 previous similar message [ 8534.991963] Lustre: lustre-MDT0001: new disk, initializing [ 8535.068261] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8535.098937] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 8535.112842] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 8540.677783] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8551.943982] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8559.212370] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8566.371843] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8566.688733] Lustre: lustre-OST0000: new disk, initializing [ 8566.692563] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8566.703907] Lustre: 300093:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8566.805901] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8571.983471] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8576.617121] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 8576.627327] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 8576.746472] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 8581.760098] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8588.768184] Lustre: Setting parameter lustre-MDT0000.mdd.atime_diff=62 in log lustre-MDT0000 [ 8601.635802] Lustre: Modifying parameter lustre-MDT0000.mdd.atime_diff=63 in log lustre-MDT0000 [ 8604.427801] Lustre: Setting parameter lustre-client.llite.max_read_ahead_mb=32 in log lustre-client [ 8610.968385] Lustre: Modifying parameter lustre-client.llite.max_read_ahead_mb=64 in log lustre-client [ 8664.032935] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8664.040809] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8664.055207] Lustre: Skipped 1 previous similar message [ 8664.070985] Lustre: Skipped 1 previous similar message [ 8667.923749] Lustre: server umount lustre-OST0000 complete [ 8673.251261] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8673.258868] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8673.280814] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8674.277320] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8674.300137] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8674.310788] Lustre: Skipped 1 previous similar message [ 8678.514025] Lustre: server umount lustre-MDT0000 complete [ 8682.698596] LustreError: 298115:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785228190 with bad export cookie 3054213995655493356 [ 8682.708890] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8682.714841] LustreError: 298115:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [ 8683.125922] Lustre: server umount lustre-MDT0001 complete [ 8692.949345] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8698.062503] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8703.908633] Lustre: server umount MGS complete [ 8716.833396] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8717.134212] LustreError: 303837:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8717.146395] LustreError: 303837:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [ 8717.156397] LustreError: 303850:0:(qmt_pool.c:1645:qmt_pool_add_rem()) lustre-QMT0000: can't remove lustre-OST0000_UUID pool 'pool1': rc = -22 [ 8717.205367] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8721.982185] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8722.406340] LustreError: 303838:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8727.522800] LustreError: 303837:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8731.290693] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8731.608632] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 8738.344692] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8748.746466] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 8756.379205] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 8764.394027] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8765.073232] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8772.183769] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8780.051155] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 8817.633187] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [ 8817.643194] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8817.676622] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 8818.538252] Lustre: server umount lustre-OST0000 complete [ 8828.896970] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 8828.897257] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 8828.912939] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 8828.941305] Lustre: Skipped 1 previous similar message [ 8835.220066] Lustre: server umount lustre-MDT0000 complete [ 8839.498789] LustreError: 303818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785228347 with bad export cookie 3054213995655495183 [ 8839.503558] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 8839.507279] LustreError: 303818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages [ 8839.952676] Lustre: server umount lustre-MDT0001 complete [ 8852.309604] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [ 8857.013655] Key type lgssc unregistered [ 8857.325738] LNet: 307802:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [ 8857.334701] LNetError: 307802:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [ 8857.349744] LNet: Removed LNI 192.168.202.131@tcp [ 8858.627906] Key type .llcrypt unregistered [ 8858.629739] Key type ._llcrypt unregistered [ 8886.465173] Key type ._llcrypt registered [ 8886.467362] Key type .llcrypt registered [ 8886.571541] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 8902.385259] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 8903.893761] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [ 8903.914492] alg: No test for adler32 (adler32-zlib) [ 8904.903760] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [ 8905.086429] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [ 8906.735130] Key type lgssc registered [ 8907.431483] Lustre: Echo OBD driver; http://www.lustre.org/ [ 8929.502747] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 8949.529044] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [ 8949.560931] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 8950.827902] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 8950.867897] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 8950.967970] Lustre: lustre-MDT0000: new disk, initializing [ 8951.039324] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 8951.060185] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 8956.290282] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8967.768155] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 8968.049675] Lustre: lustre-OST0000: new disk, initializing [ 8968.055272] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 8968.060650] Lustre: Skipped 1 previous similar message [ 8968.066513] Lustre: 311853:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 8968.153603] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 8974.669587] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 8977.000677] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost [ 8977.011617] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] [ 8977.054757] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 [ 9796.065374] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9796.087532] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9797.392591] Lustre: server umount lustre-MDT0000 complete [ 9801.822486] LustreError: 312920:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785229309 with bad export cookie 16770240370349820107 [ 9801.833148] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9801.840542] LustreError: 312920:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9802.004580] Lustre: server umount lustre-OST0000 complete [ 9831.674726] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [ 9840.649394] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [ 9884.320233] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9884.517685] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [ 9884.534042] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [ 9884.604238] Lustre: lustre-MDT0000: new disk, initializing [ 9884.739761] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [ 9884.760336] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [ 9889.882743] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 9904.207665] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [ 9904.317435] Lustre: 316191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [ 9904.362467] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [ 9904.365184] Lustre: Skipped 1 previous similar message [ 9904.486538] Lustre: lustre-MDT0001: new disk, initializing [ 9904.614649] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [ 9904.653050] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [ 9904.677689] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [ 9910.754306] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 9919.837890] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [ 9926.149744] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [ 9933.884661] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 9934.292369] Lustre: lustre-OST0000: new disk, initializing [ 9934.300273] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [ 9934.310832] Lustre: 318160:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [ 9934.427425] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [ 9940.577238] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [ 9940.586246] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [ 9940.775563] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [ 9941.591988] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [ 9952.144490] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [ 9958.240607] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [ 9958.472841] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [ 9963.142165] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [ 9963.330224] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [ 9966.562023] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9966.593297] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [ 9966.594717] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [ 9966.622406] Lustre: Skipped 1 previous similar message [ 9971.534933] Lustre: server umount lustre-OST0000 complete [ 9976.288048] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [ 9976.292688] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [ 9976.299209] Lustre: Skipped 1 previous similar message [ 9976.302751] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [ 9980.831175] Lustre: server umount lustre-MDT0000 complete [ 9983.696222] LustreError: 316183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785229491 with bad export cookie 16770240370352760926 [ 9983.697868] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [ 9983.711522] LustreError: 316183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [ 9984.012212] Lustre: server umount lustre-MDT0001 complete [10002.793938] Lustre: DEBUG MARKER: SKIP: conf-sanity test_111 skipping SLOW test 111 [10004.340799] Lustre: DEBUG MARKER: == conf-sanity test 112a: mount OST with no_create option ========================================================== 05:05:11 (1785229511) [10012.215503] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10013.227190] LustreError: 320492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10013.271861] LustreError: 320492:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [10013.371726] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10018.801507] LustreError: 320493:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10019.734174] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10023.906518] LustreError: 320492:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10029.028419] LustreError: 320493:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10030.220835] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10030.539951] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10036.185338] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10044.220836] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10051.092486] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [10057.920168] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10058.175208] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10064.827385] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10072.229913] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10079.696726] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10079.848477] Lustre: lustre-OST0001: new disk, initializing [10079.850967] Lustre: srv-lustre-OST0001: No data found on store. Initialize space. [10079.855147] Lustre: 323328:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [10079.940499] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10086.275355] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10087.003983] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost [10087.013452] Lustre: cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] [10087.056322] LustreError: 323728:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [10088.108296] LustreError: 323728:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: cannot cleanup orphans: rc = -1 [10088.120429] LustreError: 323728:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 2 previous similar messages [10089.146195] LustreError: 323719:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10091.247559] LustreError: 323719:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10091.256878] LustreError: 323719:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 3 previous similar messages [10095.393402] LustreError: 323719:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10095.403500] LustreError: 323719:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 7 previous similar messages [10096.169251] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [10096.428961] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [10102.863283] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9a4d0371d800.ost_server_uuid 50 [10103.664847] LustreError: 323719:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: cannot cleanup orphans: rc = -1 [10103.671131] LustreError: 323719:0:(osp_precreate.c:974:osp_precreate_cleanup_orphans()) Skipped 15 previous similar messages [10104.306570] Lustre: DEBUG MARKER: osc.lustre-OST0000-osc-ffff9a4d0371d800.ost_server_uuid in FULL state after 0 sec [10110.708983] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9a4d0371d800.ost_server_uuid 50 [10112.206646] Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9a4d0371d800.ost_server_uuid in FULL state after 0 sec [10114.161784] Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 [10128.362898] Lustre: lustre-OST0001-osc-MDT0000: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10128.367317] Lustre: Skipped 1 previous similar message [10128.368067] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10128.371413] Lustre: Skipped 2 previous similar messages [10132.372331] Lustre: lustre-OST0001: Not available for connect from 192.168.202.31@tcp (stopping) [10133.873884] Lustre: server umount lustre-OST0001 complete [10137.454454] LustreError: 324164:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.202.31@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [10143.727917] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10143.750923] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10143.751062] Lustre: Skipped 1 previous similar message [10143.796558] Lustre: Skipped 3 previous similar messages [10148.704870] Lustre: server umount lustre-OST0000 complete [10153.440880] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10153.443619] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10163.169328] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10163.180161] Lustre: Skipped 5 previous similar messages [10167.263254] Lustre: lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? [10167.346950] Lustre: server umount lustre-MDT0000 complete [10168.295207] LustreError: 325067:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10168.316068] LustreError: 325067:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 4 previous similar messages [10171.365492] LustreError: 321228:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785229679 with bad export cookie 16770240370352761808 [10171.372654] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10171.383069] LustreError: 321228:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [10172.313904] Lustre: server umount lustre-MDT0001 complete [10185.740454] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [10188.498879] Key type lgssc unregistered [10188.679481] LNet: 326023:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10188.682311] LNetError: 326023:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [10188.694275] LNet: Removed LNI 192.168.202.131@tcp [10189.493488] Key type .llcrypt unregistered [10189.494751] Key type ._llcrypt unregistered [10216.789595] Key type ._llcrypt registered [10216.790899] Key type .llcrypt registered [10216.934798] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [10218.546831] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10218.637497] alg: No test for adler32 (adler32-zlib) [10219.727403] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [10219.978671] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [10221.648447] Key type lgssc registered [10222.725762] Lustre: Echo OBD driver; http://www.lustre.org/ [10230.123289] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10230.138845] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10231.622484] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10237.022791] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10242.019186] LustreError: 327448:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10242.062498] LustreError: 327448:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [10244.858337] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [10247.146402] LustreError: 327447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10252.264754] LustreError: 327447:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10252.326412] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10252.575345] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10257.881851] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10268.158244] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10268.434291] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10275.392557] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10276.671546] LustreError: 329125:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10276.690940] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:65) [10282.988891] LustreError: 329547:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10283.022153] LustreError: 329547:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [10284.529111] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10292.232090] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10292.533337] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10297.850960] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:33) [10299.761163] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10308.353344] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [10315.567117] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state (FULL|IDLE) os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50 [10315.792567] Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [10420.710937] LustreError: lustre-OST0001-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [10420.719922] Lustre: lustre-OST0001-osc-MDT0001: Connection to lustre-OST0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10420.726445] Lustre: lustre-OST0001: Not available for connect from 0@lo (stopping) [10420.737379] Lustre: Skipped 1 previous similar message [10422.575527] Lustre: server umount lustre-OST0001 complete [10425.837889] LustreError: 329127:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10425.852929] LustreError: 329127:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [10430.433833] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [10430.442842] LustreError: Skipped 1 previous similar message [10430.450263] Lustre: lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10430.479034] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [10430.481605] Lustre: Skipped 1 previous similar message [10435.713932] Lustre: server umount lustre-OST0000 complete [10441.189885] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10441.209080] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10441.211324] Lustre: Skipped 2 previous similar messages [10441.218509] Lustre: Skipped 1 previous similar message [10446.070591] Lustre: server umount lustre-MDT0000 complete [10446.304285] LustreError: 327448:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10446.316356] LustreError: 327448:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [10450.118518] LustreError: 331131:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785229957 with bad export cookie 17635419529207356720 [10450.123270] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10450.138457] LustreError: 331131:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10450.719715] Lustre: server umount lustre-MDT0001 complete [10461.022862] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [10463.515557] Key type lgssc unregistered [10463.768598] LNet: 332391:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [10463.774253] LNetError: 332391:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [10464.812369] LNet: Removed LNI 192.168.202.131@tcp [10465.715448] Key type .llcrypt unregistered [10465.718770] Key type ._llcrypt unregistered [10510.882224] Key type ._llcrypt registered [10510.884189] Key type .llcrypt registered [10511.001729] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [10512.262985] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [10512.275068] alg: No test for adler32 (adler32-zlib) [10513.342696] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [10513.622118] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [10515.287168] Key type lgssc registered [10517.060461] Lustre: Echo OBD driver; http://www.lustre.org/ [10526.788067] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [10526.821884] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10528.251977] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10533.596307] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10538.466686] LustreError: 334689:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10538.484444] LustreError: 334689:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [10542.988229] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10543.685907] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10549.388566] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10552.885716] Lustre: Modifying parameter general.debug_raw_pointers=Y in log params [10560.020709] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10560.229731] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10565.276868] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10568.433313] LustreError: 336178:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10573.614147] LustreError: 336179:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10573.640722] LustreError: 336179:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [10573.653731] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:97) [10575.898487] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10576.508671] Lustre: lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 [10581.503295] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:65) [10585.016887] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10595.444847] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10605.639379] Lustre: Setting parameter general.lod.*.mdt_hash=crush in log params [10620.385551] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10620.399733] Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10620.449209] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10622.476925] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10622.485278] Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10622.525739] Lustre: Skipped 2 previous similar messages [10624.619151] Lustre: server umount lustre-MDT0000 complete [10627.573683] LustreError: 334686:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10627.607784] LustreError: 334686:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 3 previous similar messages [10630.120773] LustreError: 334671:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785230137 with bad export cookie 14457160731105165947 [10630.137895] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10630.139633] LustreError: 334671:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10630.874970] Lustre: server umount lustre-MDT0001 complete [10646.686479] Lustre: server umount lustre-OST0000 complete [10648.870931] Lustre: 333953:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785230140/real 1785230140] req@ffff9e18472d5180 x1871949354568448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785230156 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [10648.902440] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10650.074489] Lustre: server umount lustre-OST0001 complete [10669.601800] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [10681.941107] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10682.451662] LustreError: 339956:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10682.602175] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [10687.082722] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10693.089842] LustreError: 339957:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10693.114491] LustreError: 339957:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [10696.760469] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [10697.063823] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [10701.723471] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10705.323838] Lustre: 341097:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 [10713.488676] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10713.935208] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [10722.031604] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10722.171309] LustreError: 341451:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10727.294454] Lustre: lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:36 to 0x280000401:129) [10732.459730] LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [10738.199511] Lustre: lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:3 to 0x2c0000401:97) [10740.709858] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [10749.543570] Lustre: DEBUG MARKER: Using TIMEOUT=20 [10753.521476] Lustre: 342968:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 [10763.744396] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [10763.763946] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10763.774031] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [10763.774039] Lustre: Skipped 3 previous similar messages [10763.810700] Lustre: Skipped 2 previous similar messages [10765.399703] Lustre: server umount lustre-MDT0000 complete [10768.869078] LustreError: 339953:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [10768.899767] LustreError: 339953:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 7 previous similar messages [10769.570762] LustreError: 339937:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785230277 with bad export cookie 14457160731105167648 [10769.576104] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [10769.579187] LustreError: 339937:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [10769.899388] Lustre: server umount lustre-MDT0001 complete [10784.931270] Lustre: server umount lustre-OST0000 complete [10789.153486] Lustre: 333951:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1785230281/real 1785230281] req@ffff9e1845e8aa00 x1871949354620416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1785230297 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 [10789.192810] Lustre: lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [10789.210881] Lustre: Skipped 1 previous similar message [10789.630771] Lustre: server umount lustre-OST0001 complete [10793.984447] Lustre: DEBUG MARKER: SKIP: conf-sanity test_114 skipping SLOW test 114 [10795.597796] Lustre: DEBUG MARKER: SKIP: conf-sanity test_115 skipping excluded test 115 [10797.462041] Lustre: DEBUG MARKER: == conf-sanity test 116: big size MDT support ============ 05:18:23 (1785230303) [10823.671146] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [10834.483732] loop0: detected capacity change from 0 to 1099511627776 [10835.170136] SGI XFS with ACLs, security attributes, quota, no debug enabled [10835.178636] *** VALIDATE xfs *** [10835.211693] XFS (loop0): Mounting V5 Filesystem [10835.274808] XFS (loop0): Ending clean mount [10836.932672] loop1: detected capacity change from 0 to 18691697672192 [10971.225791] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [10991.629037] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [11043.813669] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11044.315043] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [11044.410660] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [11044.608772] Lustre: lustre-MDT0000: new disk, initializing [11044.797395] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11044.800227] Lustre: Skipped 1 previous similar message [11044.831417] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [11049.964390] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11063.100927] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11063.264293] Lustre: 348135:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11063.346697] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [11063.355545] Lustre: Skipped 1 previous similar message [11063.431703] Lustre: lustre-MDT0001: new disk, initializing [11063.576776] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [11063.595347] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [11068.886679] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11079.029462] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11084.748953] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [11091.761069] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11092.180433] Lustre: lustre-OST0000: new disk, initializing [11092.185198] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [11092.199829] Lustre: 350107:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [11094.096641] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [11094.109803] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [11094.205366] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [11098.903756] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11109.272416] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11114.773622] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50 [11115.060500] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec [11121.401816] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid 50 [11121.746764] Lustre: DEBUG MARKER: os[cp].lustre-OST0000-osc-MDT0001.ost_server_uuid in FULL state after 0 sec [11125.216613] LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 [11125.220092] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11125.235451] LustreError: Skipped 1 previous similar message [11125.239385] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11125.239393] Lustre: Skipped 3 previous similar messages [11125.263256] Lustre: Skipped 1 previous similar message [11130.393488] LustreError: 350205:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11130.413922] LustreError: 350205:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [11130.566714] Lustre: server umount lustre-OST0000 complete [11135.456681] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [11135.472347] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [11135.484556] Lustre: Skipped 2 previous similar messages [11141.835311] Lustre: server umount lustre-MDT0000 complete [11147.123891] LustreError: 350105:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785230654 with bad export cookie 14457160731105169195 [11147.129408] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11147.131799] LustreError: 350105:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages [11147.894299] Lustre: server umount lustre-MDT0001 complete [11159.427437] XFS (loop0): Unmounting Filesystem [11165.659978] Lustre: DEBUG MARKER: == conf-sanity test 117: lctl get_param return errors properly ========================================================== 05:24:31 (1785230671) [11172.243459] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11173.175844] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11173.179096] Lustre: Skipped 2 previous similar messages [11178.402494] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11187.666601] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11192.730662] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11201.627166] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11208.213258] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [11215.861406] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11223.077226] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11231.314754] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11248.106297] Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11248.113785] Lustre: Skipped 2 previous similar messages [11248.129078] LustreError: lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 [11248.133297] Lustre: lustre-OST0000: Not available for connect from 0@lo (stopping) [11248.135888] LustreError: Skipped 1 previous similar message [11248.148661] Lustre: Skipped 3 previous similar messages [11252.372483] Lustre: server umount lustre-OST0000 complete [11263.109423] Lustre: server umount lustre-MDT0000 complete [11263.478426] LustreError: 353397:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11263.499103] LustreError: 353397:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 7 previous similar messages [11269.289664] LustreError: 352651:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785230777 with bad export cookie 14457160731105170084 [11269.300113] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [11269.307938] LustreError: 352651:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 1 previous similar message [11269.838983] Lustre: server umount lustre-MDT0001 complete [11284.253659] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [11287.116946] Key type lgssc unregistered [11287.622446] LNet: 356300:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [11287.632447] LNetError: 356300:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [11287.651811] LNet: Removed LNI 192.168.202.131@tcp [11288.918180] Key type .llcrypt unregistered [11288.920573] Key type ._llcrypt unregistered [11323.369704] Key type ._llcrypt registered [11323.371741] Key type .llcrypt registered [11323.489751] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [11324.859486] libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 1 [11325.167915] alg: No test for adler32 (adler32-zlib) [11326.333333] Lustre: Lustre: Build Version: 2.17.54_204_g5db9db4 [11326.691672] LNet: Added LNI 192.168.202.131@tcp [8/256/0/180] [11328.391168] Key type lgssc registered [11329.745735] Lustre: Echo OBD driver; http://www.lustre.org/ [11338.395679] Lustre: lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' [11338.419875] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11339.874712] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [11344.675498] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11349.989744] LustreError: 357874:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11350.002408] LustreError: 357874:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [11353.101394] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11353.683473] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11358.749552] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11366.999232] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [11373.321741] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [11382.347914] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [11382.855627] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [11390.311925] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11402.340934] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [11414.017919] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11414.048703] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11415.445900] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.31@tcp (stopping) [11415.472893] Lustre: Skipped 1 previous similar message [11419.004973] Lustre: server umount lustre-MDT0001 complete [11419.138246] LustreError: 359207:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11419.189151] LustreError: 359207:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [11420.537241] LustreError: 357871:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.31@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11424.230933] LustreError: 357871:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11424.278015] LustreError: 357871:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [11429.349000] LustreError: 357870:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [11429.368577] LustreError: 357870:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 2 previous similar messages [11432.236738] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11432.347521] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11432.354557] Lustre: Found index 1 for lustre-MDT0001, updating log [11432.392693] Lustre: 357864:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11432.649293] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11438.079233] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [11438.274763] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11439.650968] LustreError: 361387:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [11439.660474] LustreError: 361387:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [11439.674898] LustreError: 357867:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [11439.851888] LustreError: 361399:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.131@tcp: cfg command failed: rc = -17 [11439.863818] Lustre: cmd=cf001 0:lustre-MDT0001-osp-MDT0000 1:osp 2:lustre-MDT0000-mdtlov_UUID [11439.863818] [11448.290302] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11448.293422] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [11448.309299] Lustre: Skipped 1 previous similar message [11448.323510] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11451.291228] Lustre: lustre-MDT0001: Not available for connect from 192.168.202.31@tcp (stopping) [11451.312615] Lustre: Skipped 1 previous similar message [11454.067752] Lustre: server umount lustre-MDT0001 complete [11456.372923] LustreError: 357869:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.31@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11456.384808] LustreError: 357869:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 1 previous similar message [11467.588088] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11467.743085] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11467.745397] Lustre: Found index 1 for lustre-MDT0001, updating log [11467.826512] Lustre: 357864:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11468.359635] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [11473.388338] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [11474.429619] LustreError: 362382:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [11474.448278] LustreError: 362382:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [11474.463348] LustreError: 357867:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [11474.470397] LustreError: 357867:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [11474.544502] LustreError: 362392:0:(obd_config.c:761:class_setup()) osp: device 8 already setup: rc = -17 [11474.552957] LustreError: 362392:0:(obd_config.c:866:class_detach()) OBD device 8 still set up [11474.566236] LustreError: 362392:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.131@tcp: cfg command failed: rc = -17 [11474.574638] Lustre: cmd=cf003 0:lustre-MDT0001-osp-MDT0000 1:lustre-MDT0001_UUID 2:192.168.202.131@tcp [11474.574638] [11474.681226] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11780.583197] Lustre: lustre-MDT0001-osp-MDT0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [11780.584933] LustreError: lustre-MDT0001-osp-MDT0000: operation mds_statfs to node 0@lo failed: rc = -107 [11780.599768] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [11780.599776] Lustre: Skipped 2 previous similar messages [11786.998896] Lustre: server umount lustre-MDT0001 complete [11789.167979] LustreError: 363375:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 192.168.202.31@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. [11789.177830] LustreError: 363375:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 6 previous similar messages [11797.721441] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [11797.832062] Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0 [11797.833928] Lustre: Found index 1 for lustre-MDT0001, updating log [11797.919389] Lustre: 357862:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [11798.364878] Lustre: lustre-MDT0001: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180 [11803.593392] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [11803.644404] Lustre: lustre-MDT0001-lwp-OST0000: Connection restored to 0@lo (at 0@lo) [11804.671264] LustreError: 370782:0:(obd_mount.c:234:lustre_start_simple()) lustre-MDT0001-lwp-OST0000 attach error -17 [11804.685300] LustreError: 370782:0:(tgt_mount.c:675:lustre_lwp_setup()) lustre-MDT0001-lwp-OST0000: setup up failed: rc -17 [11804.701745] LustreError: 357867:0:(mgc_request.c:614:do_requeue()) failed processing log: -17 [11804.711217] LustreError: 357867:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message [11804.818211] LustreError: 370792:0:(lod_lov.c:210:lod_add_device()) lustre-MDT0001-osp-MDT0000: cannot connect to next dev lustre-MDT0001_UUID (-114) [11804.863648] LustreError: 370792:0:(obd_config.c:2103:class_config_llog_handler()) MGC192.168.202.131@tcp: cfg command failed: rc = -114 [11804.878657] Lustre: cmd=cf014 0:lustre-MDT0000-mdtlov 1:lustre-MDT0001_UUID 2:1 3:1 [11804.878657] [12126.188181] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12126.189227] LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 [12126.201911] Lustre: Skipped 1 previous similar message [12126.203845] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12126.217145] Lustre: Skipped 6 previous similar messages [12133.239322] Lustre: server umount lustre-MDT0000 complete [12136.425144] LustreError: 363375:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [12136.464457] LustreError: 363375:0:(ldlm_lib.c:1192:target_handle_connect()) Skipped 7 previous similar messages [12138.673367] LustreError: 370466:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785231646 with bad export cookie 2239114752290919954 [12138.680266] LustreError: 370466:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages [12138.681014] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12141.545784] Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12141.575064] Lustre: Skipped 2 previous similar messages [12143.593961] Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) [12143.602629] Lustre: Skipped 4 previous similar messages [12144.980945] Lustre: server umount lustre-MDT0001 complete [12150.856339] Lustre: server umount lustre-OST0000 complete [12161.922927] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [12172.917929] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [12210.879372] Lustre: DEBUG MARKER: == conf-sanity test 120: cross-target rename should not create bad symlinks ========================================================== 05:41:57 (1785231717) [12217.226098] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12217.515974] Lustre: Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 [12217.543765] Lustre: ctl-lustre-MDT0000: No data found on store. Initialize space. [12217.621552] Lustre: lustre-MDT0000: new disk, initializing [12217.735269] Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 [12217.746862] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt [12222.455935] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [12232.749211] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc [12232.839943] Lustre: 381364:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 [12232.911535] Lustre: srv-lustre-MDT0001: No data found on store. Initialize space. [12232.919625] Lustre: Skipped 1 previous similar message [12233.036267] Lustre: lustre-MDT0001: new disk, initializing [12233.153064] Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 [12233.214884] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt [12233.235391] Lustre: cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] [12237.155894] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [12244.778658] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 [12249.268832] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 [12255.516039] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [12255.757468] Lustre: lustre-OST0000: new disk, initializing [12255.759507] Lustre: srv-lustre-OST0000: No data found on store. Initialize space. [12255.766357] Lustre: 383329:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] [12255.860581] Lustre: lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 [12261.294081] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug -1 all [12265.555139] Lustre: ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost [12265.564702] Lustre: cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] [12265.665859] Lustre: lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 [12269.656374] Lustre: DEBUG MARKER: oleg231-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 [12276.196570] Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete [12276.212355] Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) [12276.214590] Lustre: Skipped 1 previous similar message [12276.231525] Lustre: Skipped 2 previous similar messages [12281.870874] Lustre: server umount lustre-MDT0000 complete [12285.240646] LustreError: 381357:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1785231793 with bad export cookie 2239114752290921907 [12285.241550] LustreError: 382170:0:(osp_object.c:618:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000401:0x2:0x0]: rc = -5 [12285.270796] LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail [12285.701810] Lustre: server umount lustre-MDT0001 complete [12300.179047] Lustre: server umount lustre-OST0000 complete [12335.055674] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing set_hostid [12348.487052] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local [12389.536283] Lustre: DEBUG MARKER: == conf-sanity test complete, duration 12079 sec ========= 05:44:55 (1785231895) [12391.282198] Lustre: DEBUG MARKER: === conf-sanity: start cleanup 05:44:57 (1785231897) === [12394.644744] Lustre: DEBUG MARKER: === conf-sanity: finish cleanup 05:45:01 (1785231901) === [12432.853679] Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local [12436.053223] Key type lgssc unregistered [12436.356454] LNet: 389697:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit [12436.370256] LNetError: 389697:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found [12436.388018] LNet: Removed LNI 192.168.202.131@tcp [12437.496891] Key type .llcrypt unregistered [12437.500721] Key type ._llcrypt unregistered